00000001:02000400:1.0F:1787782574.296899:0:2959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787782591.713776:0:3180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1787782593.540400:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 747 MB/s 00000001:01000000:2.0:1787782593.790540:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 659 MB/s 00000001:01000000:2.0:1787782594.040171:0:3243:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5051 MB/s 00000020:02000000:0.0F:1787782594.681296:0:3272:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_55_ge1b14e7 00000400:02000000:3.0F:1787782595.886551:0:3287:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.115@tcp [8/256/0/180] 00008000:02000000:1.0:1787782599.631534:0:3437:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787782648.711972:0:5245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787782659.317642:0:5831:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787782659.317648:0:5831:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787782659.317950:0:5831:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000dad18e84 00000080:02000400:0.0:1787782659.317960:0:5831:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787782659.326842:0:5831:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787782659.326855:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787782659.330433:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000756a64c5) 00000020:00000080:2.0:1787782659.330462:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787782659.371142:0:5831:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787782659.373474:0:5831:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787782659.414154:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787782659.414291:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787782659.414314:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787782659.414364:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787782659.414388:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787782659.415370:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787782659.415381:0:5831:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787782659.415392:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d98ed19b636d1a 00000020:01000004:2.0:1787782659.415401:0:5831:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787782659.415405:0:5831:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787782659.415410:0:5831:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000dad18e84 from MGS 00000020:01000004:2.0:1787782659.415414:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787782659.415425:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000005b97ce3) 00000020:00000080:2.0:1787782659.415436:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787782659.415505:0:5831:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dad18e84 from MGS, refs=2 00080000:01000000:2.0:1787782659.415511:0:5831:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787782659.415516:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d98ed19b636d28 00000100:00100000:2.0:1787782659.415643:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787782659.417273:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787782659.417283:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787782659.424207:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787782659.424222:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787782659.425232:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782659.425413:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787782659.425419:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787782659.426504:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787782659.426512:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787782659.427451:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787782659.427457:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787782659.439605:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782659.439611:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782659.439613:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782659.440003:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782659.440006:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782659.440008:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782659.441666:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787782659.443837:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787782659.691246:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2551 MB/s 00000001:01000000:3.0:1787782659.941154:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4211 MB/s 00000001:01000000:0.0:1787782660.194387:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 505 MB/s 00000001:01000000:3.0:1787782660.445630:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 561 MB/s 00010000:00010000:1.0:1787782660.451154:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1787782660.464900:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1787782660.505691:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787782660.505717:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787782660.505720:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787782660.511852:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787782660.516266:0:5831:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787782660.516328:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787782660.517004:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787782660.517587:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787782660.518986:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787782660.519708:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787782660.519715:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787782660.524904:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787782660.524921:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787782660.525456:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787782660.525470:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787782660.526053:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787782660.526073:0:5831:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.115@tcp' 00000020:01000004:3.0:1787782660.526074:0:5831:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787782660.526151:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.115@tcp (typ=mgc) 00000020:00000080:3.0:1787782660.526171:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.115@tcp (00000000b839f6d1) 00000020:00000080:3.0:1787782660.526187:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787782660.526306:0:5831:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b1257479@MGC192.168.202.115@tcp: add connection 192.168.202.115@tcp at head 00010000:00010000:3.0:1787782660.526440:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.115@tcp-0 is initialized 00000040:01000000:3.0:1787782660.526447:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787782660.528643:0:5847:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787782660.531586:0:5848:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787782660.531745:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.115@tcp (uuid db359560-8e1a-42c0-a155-5e020d83d9a3) 00000020:00000080:3.0:1787782660.531769:0:5831:0:(genops.c:1385:class_connect()) connect: client db359560-8e1a-42c0-a155-5e020d83d9a3, cookie 0x6d98ed19b636d36 00000100:00080000:3.0:1787782660.531781:0:5831:0:(import.c:510:import_select_connection()) MGC192.168.202.115@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787782660.531786:0:5831:0:(import.c:624:import_select_connection()) MGC192.168.202.115@tcp: import 00000000b1257479 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:3.0:1787782660.531844:0:5831:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000520b54ba x1874625922334848/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787782660.531872:0:5831:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import db359560-8e1a-42c0-a155-5e020d83d9a3->MGS 00000020:01000004:3.0:1787782660.531901:0:5831:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787782660.531907:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787782660.531920:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c224b806) 00000020:00000080:3.0:1787782660.531931:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787782660.535302:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000520b54ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:db359560-8e1a-42c0-a155-5e020d83d9a3:3303:1874625922334848:0@lo:250: 00000100:00100000:2.0:1787782660.535397:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782660.535498:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922334848 00000100:00100000:2.0:1787782660.535507:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922334848 00000100:00100000:2.0:1787782660.535540:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782660.535547:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ea39867 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1874625922334848:12345-0@lo:250: 00010000:00080000:2.0:1787782660.535574:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from db359560-8e1a-42c0-a155-5e020d83d9a3@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:2.0:1787782660.535607:0:5844:0:(genops.c:1385:class_connect()) connect: client db359560-8e1a-42c0-a155-5e020d83d9a3, cookie 0x6d98ed19b636d44 00000100:00080000:2.0:1787782660.535744:0:5844:0:(import.c:65:import_set_state_nolock()) 000000000ec8c193 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782660.535793:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ea39867 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+5:3303:x1874625922334848:12345-0@lo:250: Request processed in 246us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782660.535812:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782660.535874:0:3303:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.115@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787782660.535884:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.115@tcp: connect to target with instance 0 00000100:00080000:2.0:1787782660.535891:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.115@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787782660.535896:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787782660.535900:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000b1257479 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787782660.535909:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787782660.535918:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787782660.535922:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000520b54ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:db359560-8e1a-42c0-a155-5e020d83d9a3:3303:1874625922334848:0@lo:250: 00000100:00100000:3.0:1787782660.562940:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787782660.566024:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787782660.566033:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787782660.573375:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787782660.573391:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787782660.581027:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787782660.581049:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787782660.582937:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787782660.583328:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787782660.583334:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787782660.597237:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787782660.597259:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787782660.657825:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787782660.658045:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787782660.658051:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787782660.671283:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787782660.671301:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787782660.672949:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782660.673208:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787782660.673215:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787782660.674444:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787782660.674456:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787782660.675370:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782660.675595:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787782660.675600:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787782660.685889:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787782660.685907:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787782660.700977:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782660.701249:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787782660.701255:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787782660.701914:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787782660.701922:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787782660.796611:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787782660.796850:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787782660.796857:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787782660.800223:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787782660.800241:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787782660.817174:0:5831:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787782660.817199:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787782660.818622:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787782660.818645:0:5831:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787782660.818651:0:5831:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787782660.818779:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787782660.818834:0:5831:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.115@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787782660.818838:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787782660.818840:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787782660.818841:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787782660.818843:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787782660.818844:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787782660.818845:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787782660.818846:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787782660.818848:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787782660.818849:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787782660.818851:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787782660.818852:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787782660.818854:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787782660.818856:0:5831:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787782660.818859:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787782660.818860:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787782660.818861:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787782660.818862:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787782660.818862:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787782660.818863:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787782660.818864:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787782660.818865:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787782660.818871:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787782660.818872:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787782660.818873:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787782660.818874:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787782660.818900:0:5831:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787782660.818917:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922334976:0@lo:253: 00000100:00100000:0.0:1787782660.819454:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782660.819610:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d931ca0c going to sleep for 11 seconds 00000100:00100000:2.0:1787782660.830127:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922334976 00000100:00100000:2.0:1787782660.830142:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922334976 00000100:00100000:2.0:1787782660.830272:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787782660.830282:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce52301c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+5:5831:x1874625922334976:12345-0@lo:253: 20000000:01000000:2.0:1787782660.830345:0:5846:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787782660.830348:0:5846:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787782660.831643:0:5867:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787782660.831722:0:5846:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787782660.832048:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787782660.832964:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787782660.833729:0:5846:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787782660.833735:0:5846:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787782660.833741:0:5846:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787782660.833745:0:5846:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787782660.833761:0:5846:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787782660.833967:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787782660.834201:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787782660.834214:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787782660.834263:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787782660.834309:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787782660.834341:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787782660.834426:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787782660.834434:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787782660.834493:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787782660.834501:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787782660.834532:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787782660.834538:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787782660.834564:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787782660.834609:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787782660.834639:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787782660.834644:0:5846:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787782660.834656:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787782660.834855:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787782660.834865:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787782660.834899:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787782660.834932:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787782660.834990:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787782660.835001:0:5846:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787782660.835065:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787782660.835073:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787782660.835139:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787782660.835174:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787782660.835207:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787782660.835218:0:5846:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787782660.835292:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787782660.835301:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787782660.835327:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787782660.835357:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787782660.835499:0:5846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787782660.835538:0:5846:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787782660.835544:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787782660.835817:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787782660.835958:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787782660.835981:0:5846:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.115@tcp for mdt 20000000:01000000:2.0:1787782660.835983:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.115@tcp (null) (null) (null) 00000040:00080000:2.0:1787782660.836017:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787782660.836023:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787782660.836048:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787782660.836053:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.115@tcp (null) (null) 00000040:00080000:2.0:1787782660.836087:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787782660.836122:0:5846:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787782660.836152:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787782660.836186:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787782660.836242:0:5846:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787782660.836246:0:5846:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787782660.836249:0:5846:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787782660.836260:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787782660.836262:0:5846:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787782660.836290:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787782660.836292:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787782660.836532:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787782660.836637:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787782660.836668:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787782660.836713:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1787782660.836724:0:5846:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787782660.836725:0:5846:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787782660.842556:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1787782660.842939:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787782660.842977:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1787782660.843061:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1787782660.843075:0:5846:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787782660.843078:0:5846:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787782660.843083:0:5846:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787782660.843086:0:5846:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787782660.843091:0:5846:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787782660.843239:0:5846:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787782660.843808:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1787782660.843929:0:5846:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787782660.855344:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1787782660.855389:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1787782660.855459:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1787782660.855550:0:5846:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787782660.855570:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c210c1e6/0x6d98ed19b636d4b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782660.855587:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c210c1e6/0x6d98ed19b636d4b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782660.855595:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c210c1e6/0x6d98ed19b636d4b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782660.855601:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c210c1e6/0x6d98ed19b636d4b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782660.855606:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c210c1e6/0x6d98ed19b636d4b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782660.855612:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c210c1e6/0x6d98ed19b636d4b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782660.855618:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c210c1e6 already unused, calling callback (00000000a7688c57) 00010000:00010000:3.0:1787782660.855621:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c210c1e6/0x6d98ed19b636d4b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782660.855627:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c210c1e6/0x6d98ed19b636d4b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782660.855641:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c210c1e6/0x6d98ed19b636d4b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782660.855669:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c210c1e6/0x6d98ed19b636d4b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782660.855674:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c210c1e6/0x6d98ed19b636d4b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787782660.855690:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787782661.161702:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce52301c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+5:5831:x1874625922334976:12345-0@lo:253: Request processed in 331412us (342240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782661.161851:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787782661.161984:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922334976:0@lo:253: 10000000:01000000:0.0:1787782661.162001:0:5831:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787782661.162005:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787782661.162007:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787782661.162008:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787782661.162010:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787782661.162011:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787782661.162012:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787782661.162013:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787782661.162014:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787782661.162016:0:5831:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787782661.162017:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787782661.162018:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787782661.162037:0:5831:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000dad18e84 from lustre-MDT0000 10000000:01000000:0.0:1787782661.162062:0:5831:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787782661.162065:0:5831:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787782661.162068:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c31091e8000 10000000:01000000:0.0:1787782661.162072:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787782661.162079:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c31091e8000 from 1 10000000:01000000:0.0:1787782661.162082:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787782661.162258:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 000000007a85a77b/0x6d98ed19b636d52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.162269:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 000000007a85a77b/0x6d98ed19b636d52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.162285:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 000000007a85a77b/0x6d98ed19b636d52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782661.162302:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922335104:0@lo:101: 00000100:00100000:0.0:1787782661.162405:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782661.162488:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 000000008e290a5c going to sleep for 11 seconds 00000100:00100000:3.0:1787782661.162716:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922335104 00000100:00100000:3.0:1787782661.162723:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922335104 00000100:00100000:3.0:1787782661.162977:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787782661.162986:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000209454b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+5:5831:x1874625922335104:12345-0@lo:101: 00010000:00010000:3.0:1787782661.162999:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782661.163013:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c210c1e6/0x6d98ed19b636d59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636d52 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.163034:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c210c1e6/0x6d98ed19b636d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636d52 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.163043:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c210c1e6/0x6d98ed19b636d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636d52 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.163051:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c210c1e6, rc 0) 00000100:00100000:0.0:1787782661.163240:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922335104:0@lo:101: 00010000:00010000:0.0:1787782661.163254:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 000000007a85a77b/0x6d98ed19b636d52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636d59 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.163263:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 000000007a85a77b/0x6d98ed19b636d52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636d59 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782661.163327:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922335232:0@lo:501: 00000100:00100000:0.0:1787782661.163357:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782661.163383:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000209454b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+6:5831:x1874625922335104:12345-0@lo:101: Request processed in 398us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782661.163390:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782661.163566:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 000000008e290a5c going to sleep for 11 seconds 00000100:00100000:3.0:1787782661.163660:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922335232 00000100:00100000:3.0:1787782661.163665:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922335232 00000100:00100000:3.0:1787782661.163681:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782661.163686:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081ba6abe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+6:5831:x1874625922335232:12345-0@lo:501: 00000100:00100000:3.0:1787782661.164041:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081ba6abe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+6:5831:x1874625922335232:12345-0@lo:501: Request processed in 354us (683us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787782661.164049:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787782661.164146:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922335232:0@lo:501: 10000000:01000000:0.0:1787782661.164178:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787782661.164195:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 000000007a85a77b/0x6d98ed19b636d52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636d59 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.164204:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 000000007a85a77b/0x6d98ed19b636d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636d59 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782661.164212:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c311846c800 10000000:01000000:0.0:1787782661.164217:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787782661.164230:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c311846c800 10000000:01000000:0.0:1787782661.164233:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787782661.164236:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8c311846c800 from 1 10000000:01000000:0.0:1787782661.164239:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787782661.164268:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 0000000042bd5616/0x6d98ed19b636d60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.164276:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 0000000042bd5616/0x6d98ed19b636d60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.164284:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 0000000042bd5616/0x6d98ed19b636d60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782661.164298:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922335360:0@lo:101: 00000100:00100000:0.0:1787782661.164342:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782661.164366:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 000000008e290a5c going to sleep for 11 seconds 00000100:00100000:3.0:1787782661.164553:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922335360 00000100:00100000:3.0:1787782661.164558:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922335360 00000100:00100000:3.0:1787782661.164579:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787782661.164584:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb706b35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+6:5831:x1874625922335360:12345-0@lo:101: 00010000:00010000:3.0:1787782661.164593:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782661.164605:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ffbd56db/0x6d98ed19b636d67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636d60 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.164623:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ffbd56db/0x6d98ed19b636d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636d60 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.164630:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ffbd56db/0x6d98ed19b636d67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636d60 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.164638:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ffbd56db, rc 0) 00000100:00100000:3.0:1787782661.164673:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb706b35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+7:5831:x1874625922335360:12345-0@lo:101: Request processed in 89us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782661.164678:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787782661.164869:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922335360:0@lo:101: 00010000:00010000:0.0:1787782661.164879:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 0000000042bd5616/0x6d98ed19b636d60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636d67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.164889:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 0000000042bd5616/0x6d98ed19b636d60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636d67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782661.164899:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787782661.164912:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 0000000042bd5616/0x6d98ed19b636d60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636d67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.164918:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 0000000042bd5616/0x6d98ed19b636d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636d67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782661.164934:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787782661.164937:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787782661.164941:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c311846c800 10000000:01000000:0.0:1787782661.164944:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787782661.164947:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787782661.164949:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787782661.164962:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 00000000be2e6ea5/0x6d98ed19b636d6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.164969:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 00000000be2e6ea5/0x6d98ed19b636d6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.164976:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 00000000be2e6ea5/0x6d98ed19b636d6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782661.164987:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922335488:0@lo:101: 00000100:00100000:0.0:1787782661.165012:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782661.165024:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 000000008e290a5c going to sleep for 11 seconds 00000100:00100000:3.0:1787782661.165082:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922335488 00000100:00100000:3.0:1787782661.165087:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922335488 00000100:00100000:3.0:1787782661.165201:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787782661.165209:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002dd07269 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+7:5831:x1874625922335488:12345-0@lo:101: 00010000:00010000:3.0:1787782661.165225:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782661.165233:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000083bb30a8/0x6d98ed19b636d75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636d6e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.165246:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000083bb30a8/0x6d98ed19b636d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636d6e expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.165254:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000083bb30a8/0x6d98ed19b636d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636d6e expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.165260:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000083bb30a8, rc 0) 00000100:00100000:3.0:1787782661.165287:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002dd07269 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+8:5831:x1874625922335488:12345-0@lo:101: Request processed in 80us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782661.165292:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787782661.165424:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922335488:0@lo:101: 00010000:00010000:0.0:1787782661.165435:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 00000000be2e6ea5/0x6d98ed19b636d6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636d75 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.165442:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 00000000be2e6ea5/0x6d98ed19b636d6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636d75 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782661.165481:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922335616:0@lo:501: 00000100:00100000:0.0:1787782661.165502:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782661.165565:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 000000008e290a5c going to sleep for 11 seconds 00000100:00100000:1.0:1787782661.165616:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922335616 00000100:00100000:1.0:1787782661.165620:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922335616 00000100:00100000:2.0:1787782661.165688:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787782661.165696:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b3a8fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+8:5831:x1874625922335616:12345-0@lo:501: 00000100:00100000:2.0:1787782661.165932:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b3a8fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+9:5831:x1874625922335616:12345-0@lo:501: Request processed in 237us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782661.165938:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787782661.165995:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922335616:0@lo:501: 00000100:00100000:0.0:1787782661.166021:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922335744:0@lo:503: 00000100:00100000:0.0:1787782661.166056:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782661.166493:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 000000008e290a5c going to sleep for 11 seconds 00000100:00100000:3.0:1787782661.166545:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922335744 00000100:00100000:3.0:1787782661.166550:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922335744 00000100:00100000:3.0:1787782661.166574:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787782661.166580:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a801a272 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+9:5831:x1874625922335744:12345-0@lo:503: 00000100:00100000:3.0:1787782661.166918:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a801a272 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+9:5831:x1874625922335744:12345-0@lo:503: Request processed in 337us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782661.166926:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787782661.167028:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922335744:0@lo:503: 00000100:00100000:3.0:1787782661.167568:0:5875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a75c1afd pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:5875:1874625922335872:0@lo:502: 00000100:00100000:3.0:1787782661.167624:0:5875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782661.167661:0:5875:0:(client.c:2715:ptlrpc_set_wait()) set 00000000714886c2 going to sleep for 11 seconds 00000100:00100000:0.0:1787782661.167716:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922335872 00000100:00100000:0.0:1787782661.167721:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922335872 00000100:00100000:0.0:1787782661.167894:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787782661.167901:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e77125e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+9:5875:x1874625922335872:12345-0@lo:502: 00000100:00100000:0.0:1787782661.168254:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e77125e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+9:5875:x1874625922335872:12345-0@lo:502: Request processed in 352us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782661.168261:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787782661.168444:0:5875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a75c1afd pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:5875:1874625922335872:0@lo:502: 00000020:01000000:3.0:1787782661.168471:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782661.168481:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782661.168483:0:5875:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787782661.168494:0:5875:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787782661.168497:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787782661.168510:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000deaa79e7) 00000020:00000080:3.0:1787782661.168528:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787782661.168533:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787782661.168606:0:5875:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787782661.168613:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d98ed19b636d83 00000020:00000080:3.0:1787782661.169022:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787782661.169027:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782661.169030:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782661.169032:0:5875:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787782661.169034:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782661.169038:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782661.169039:0:5875:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787782661.169042:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787782661.169048:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000af0e9ce6) 00000020:00000080:3.0:1787782661.169058:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787782661.169062:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787782661.169064:0:5875:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787782661.169067:0:5875:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787782661.169072:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787782661.169262:0:5875:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dad18e84 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787782661.169285:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000069f9cbc) 00000020:00000080:3.0:1787782661.169295:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787782661.169422:0:5875:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787782661.169428:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d98ed19b636d98 00000020:00000080:3.0:1787782661.169518:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787782661.169523:0:5875:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787782661.169527:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6d98ed19b636d9f 00080000:01000000:3.0:1787782661.169531:0:5875:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787782661.169533:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d98ed19b636da6 00080000:10000000:3.0:1787782661.170033:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787782661.170495:0:5875:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787782661.174701:0:5875:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787782661.267200:0:5875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787782661.267502:0:5875:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787782661.270362:0:5875:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787782661.270666:0:5875:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787782661.368457:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000003bb161a0) 00000020:00000080:3.0:1787782661.368486:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787782661.368583:0:5875:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787782661.368592:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d98ed19b636db4 00000020:00000080:1.0:1787782661.373172:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787782661.374720:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787782661.417689:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787782661.441928:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00010000:00010000:1.0:1787782661.474498:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1787782661.478530:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782661.516868:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787782661.561064:0:5875:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787782661.585476:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6d98ed19b636dbb 00000020:00000080:1.0:1787782661.585907:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787782661.585918:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782661.585924:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782661.585926:0:5875:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787782661.585929:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782661.585933:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782661.585934:0:5875:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787782661.585937:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787782661.585938:0:5875:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787782661.585940:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782661.585942:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782661.585944:0:5875:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787782661.585945:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782661.585949:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782661.585950:0:5875:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787782661.585954:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787782661.585989:0:5875:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787782661.586038:0:5875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f59be9b7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:5875:1874625922336000:0@lo:502: 00000100:00100000:1.0:1787782661.586269:0:5875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782661.586319:0:5875:0:(client.c:2715:ptlrpc_set_wait()) set 000000004bdcb355 going to sleep for 11 seconds 00000100:00100000:0.0:1787782661.586385:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922336000 00000100:00100000:0.0:1787782661.586461:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922336000 00000100:00100000:0.0:1787782661.586511:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787782661.586519:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046e59579 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+9:5875:x1874625922336000:12345-0@lo:502: 00000100:00100000:0.0:1787782661.586815:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046e59579 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+9:5875:x1874625922336000:12345-0@lo:502: Request processed in 296us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782661.586823:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787782661.586870:0:5875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f59be9b7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:5875:1874625922336000:0@lo:502: 00000020:01000000:0.0:1787782661.586897:0:5875:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787782661.586902:0:5875:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782661.586903:0:5875:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787782661.586912:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787782661.586967:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787782661.586983:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787782661.586999:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 00000000be2e6ea5/0x6d98ed19b636d6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636d75 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.587009:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 00000000be2e6ea5/0x6d98ed19b636d6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636d75 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782661.587016:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c311846c800 from 1 10000000:01000000:0.0:1787782661.587019:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787782661.587043:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 00000000a3cdaed5/0x6d98ed19b636dc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.587050:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 00000000a3cdaed5/0x6d98ed19b636dc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.587057:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 00000000a3cdaed5/0x6d98ed19b636dc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782661.587069:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922336128:0@lo:101: 00000100:00100000:0.0:1787782661.587122:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782661.587513:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aaf9085c going to sleep for 11 seconds 00000100:00100000:0.0:1787782661.587543:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922336128 00000100:00100000:0.0:1787782661.587547:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922336128 00000100:00100000:0.0:1787782661.587578:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787782661.587584:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c504476 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+9:5831:x1874625922336128:12345-0@lo:101: 00010000:00010000:0.0:1787782661.587594:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782661.587608:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636dc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636dc2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.587644:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636dc2 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.587654:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636dc2 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.587662:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a67b85d7, rc 0) 00000100:00100000:0.0:1787782661.587694:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c504476 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+10:5831:x1874625922336128:12345-0@lo:101: Request processed in 110us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782661.587701:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787782661.587749:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922336128:0@lo:101: 00010000:00010000:0.0:1787782661.587761:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 00000000a3cdaed5/0x6d98ed19b636dc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636dc9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.587768:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 00000000a3cdaed5/0x6d98ed19b636dc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636dc9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782661.589891:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922336256:0@lo:256: 00000100:00100000:0.0:1787782661.589977:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782661.590124:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aaf9085c going to sleep for 11 seconds 00000100:00100000:1.0:1787782661.590529:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922336256 00000100:00100000:1.0:1787782661.590538:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922336256 00000100:00100000:1.0:1787782661.590589:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787782661.590598:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f30353f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+10:5831:x1874625922336256:12345-0@lo:256: 20000000:01000000:1.0:1787782661.590618:0:5846:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787782661.590624:0:5846:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787782661.590743:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f30353f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+10:5831:x1874625922336256:12345-0@lo:256: Request processed in 147us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782661.590751:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787782661.590857:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922336256:0@lo:256: 10000000:01000000:3.0:1787782661.591691:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787782661.591710:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 00000000a3cdaed5/0x6d98ed19b636dc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636dc9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.591721:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 00000000a3cdaed5/0x6d98ed19b636dc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636dc9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782661.591729:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c311846c800 from 1 10000000:01000000:3.0:1787782661.591732:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787782661.591763:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 00000000bc5ecbb1/0x6d98ed19b636dd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.591771:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 00000000bc5ecbb1/0x6d98ed19b636dd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.591779:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 00000000bc5ecbb1/0x6d98ed19b636dd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782661.591804:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a75c1afd pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922336384:0@lo:101: 00000100:00100000:3.0:1787782661.591848:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782661.591874:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ac3db66 going to sleep for 11 seconds 00000100:00100000:1.0:1787782661.592295:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922336384 00000100:00100000:1.0:1787782661.592302:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922336384 00000100:00100000:1.0:1787782661.592341:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787782661.592347:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0eff4ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+10:5831:x1874625922336384:12345-0@lo:101: 00010000:00010000:1.0:1787782661.592358:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782661.592369:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000051e5efc6/0x6d98ed19b636dd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636dd0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.592387:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051e5efc6/0x6d98ed19b636dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636dd0 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.592465:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000051e5efc6/0x6d98ed19b636dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636dd0 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.592473:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000051e5efc6, rc 0) 00000100:00100000:1.0:1787782661.592510:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0eff4ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+11:5831:x1874625922336384:12345-0@lo:101: Request processed in 163us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782661.592517:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787782661.592566:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a75c1afd pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922336384:0@lo:101: 00010000:00010000:1.0:1787782661.592579:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 00000000bc5ecbb1/0x6d98ed19b636dd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636dd7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.592587:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 00000000bc5ecbb1/0x6d98ed19b636dd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636dd7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782661.592634:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000074ae54ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922336512:0@lo:501: 00000100:00100000:1.0:1787782661.592656:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782661.592673:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 000000004bdcb355 going to sleep for 11 seconds 00000100:00100000:1.0:1787782661.592684:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922336512 00000100:00100000:1.0:1787782661.592687:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922336512 00000100:00100000:1.0:1787782661.592702:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787782661.592706:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc8ce2ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+11:5831:x1874625922336512:12345-0@lo:501: 00000100:00100000:1.0:1787782661.593731:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc8ce2ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+11:5831:x1874625922336512:12345-0@lo:501: Request processed in 1013us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782661.593740:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787782661.593945:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000074ae54ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922336512:0@lo:501: 00000100:00100000:3.0:1787782661.594001:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042929c3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922336640:0@lo:503: 00000100:00100000:3.0:1787782661.594042:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782661.594453:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072d798ea going to sleep for 11 seconds 00000100:00100000:2.0:1787782661.594494:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922336640 00000100:00100000:2.0:1787782661.594499:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922336640 00000100:00100000:2.0:1787782661.594563:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787782661.594572:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b75121bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+11:5831:x1874625922336640:12345-0@lo:503: 00000040:00080000:2.0:1787782661.594612:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787782661.594655:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b75121bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+11:5831:x1874625922336640:12345-0@lo:503: Request processed in 85us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782661.594662:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787782661.594735:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042929c3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922336640:0@lo:503: 00000040:00080000:3.0:1787782661.595833:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787782661.596006:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787782661.596026:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787782661.596047:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 00000000bc5ecbb1/0x6d98ed19b636dd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636dd7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.596057:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 00000000bc5ecbb1/0x6d98ed19b636dd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636dd7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782661.596147:0:5831:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787782661.596150:0:5831:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c311846c800 10000000:01000000:0.0:1787782661.596153:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c311846c800 10000000:01000000:0.0:1787782661.596163:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787782661.596168:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c311846c800 from 1 10000000:01000000:0.0:1787782661.596171:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787782661.596203:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 000000001b9742e9/0x6d98ed19b636dde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.596211:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 000000001b9742e9/0x6d98ed19b636dde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782661.596220:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 000000001b9742e9/0x6d98ed19b636dde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782661.596240:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000050a947f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922336768:0@lo:101: 00000100:00100000:0.0:1787782661.596287:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782661.596700:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aecaddb7 going to sleep for 11 seconds 00000100:00100000:1.0:1787782661.596811:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922336768 00000100:00100000:1.0:1787782661.596817:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922336768 00000100:00100000:1.0:1787782661.596852:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787782661.596858:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b73b51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+11:5831:x1874625922336768:12345-0@lo:101: 00010000:00010000:1.0:1787782661.596870:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782661.596880:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000047b93993/0x6d98ed19b636de5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636dde expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.596901:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000047b93993/0x6d98ed19b636de5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636dde expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.596910:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000047b93993/0x6d98ed19b636de5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636dde expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.596928:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000047b93993, rc 0) 00000100:00100000:1.0:1787782661.596971:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b73b51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5831:x1874625922336768:12345-0@lo:101: Request processed in 112us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782661.596977:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787782661.597050:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000050a947f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922336768:0@lo:101: 00010000:00010000:3.0:1787782661.597062:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 000000001b9742e9/0x6d98ed19b636dde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636de5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.597070:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 000000001b9742e9/0x6d98ed19b636dde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636de5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782661.597151:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042929c3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922336896:0@lo:501: 00000100:00100000:3.0:1787782661.597186:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782661.597202:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2dcbf1e going to sleep for 11 seconds 00000100:00100000:1.0:1787782661.597577:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922336896 00000100:00100000:1.0:1787782661.597582:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922336896 00000100:00100000:1.0:1787782661.597603:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787782661.597608:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1f01273 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5831:x1874625922336896:12345-0@lo:501: 00000100:00100000:1.0:1787782661.597942:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1f01273 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5831:x1874625922336896:12345-0@lo:501: Request processed in 334us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782661.597949:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787782661.598078:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042929c3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922336896:0@lo:501: 00000100:00100000:3.0:1787782661.598297:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042929c3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922337024:0@lo:503: 00000100:00100000:3.0:1787782661.598338:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782661.598365:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2dcbf1e going to sleep for 11 seconds 00000100:00100000:1.0:1787782661.598505:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922337024 00000100:00100000:1.0:1787782661.598509:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922337024 00000100:00100000:1.0:1787782661.598564:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787782661.598571:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e5c01df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5831:x1874625922337024:12345-0@lo:503: 00000100:00100000:1.0:1787782661.598893:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e5c01df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5831:x1874625922337024:12345-0@lo:503: Request processed in 322us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782661.598901:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787782661.598964:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042929c3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922337024:0@lo:503: 00000100:00100000:2.0:1787782661.600073:0:5880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b8cefb53 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:5880:1874625922337152:0@lo:502: 00000100:00100000:0.0:1787782661.600494:0:5880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782661.600567:0:5880:0:(client.c:2715:ptlrpc_set_wait()) set 000000006780cafb going to sleep for 11 seconds 00000100:00100000:2.0:1787782661.600604:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922337152 00000100:00100000:2.0:1787782661.600610:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922337152 00000100:00100000:2.0:1787782661.600685:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787782661.600695:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7d78a88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5880:x1874625922337152:12345-0@lo:502: 00000100:00100000:2.0:1787782661.600962:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7d78a88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5880:x1874625922337152:12345-0@lo:502: Request processed in 269us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782661.600970:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787782661.601046:0:5880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b8cefb53 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:5880:1874625922337152:0@lo:502: 00000020:01000004:0.0:1787782661.601146:0:5880:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787782661.601175:0:5880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000005cbd8b35) 00000020:00000080:0.0:1787782661.601193:0:5880:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787782661.601301:0:5880:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000dad18e84 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787782661.601305:0:5880:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000dad18e84 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787782661.601307:0:5880:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000dad18e84 4 00010000:00080000:0.0:1787782661.601333:0:5880:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000af3ca307@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:0.0:1787782661.602843:0:5880:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1787782661.603040:0:5880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787782661.603075:0:5880:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787782661.603088:0:5880:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6d98ed19b636df3 00000100:00080000:0.0:1787782661.603120:0:5880:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787782661.603125:0:5880:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000af3ca307 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:0.0:1787782661.603170:0:5880:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004d271ad9 x1874625922337280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787782661.603215:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d271ad9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625922337280:0@lo:38: 00000100:00100000:0.0:1787782661.603273:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787782661.603326:0:5880:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787782661.603530:0:5880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000050a947f2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:5880:1874625922337408:0@lo:502: 00000100:00100000:0.0:1787782661.603571:0:5880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782661.604424:0:5880:0:(client.c:2715:ptlrpc_set_wait()) set 000000000704356e going to sleep for 11 seconds 00000100:00100000:1.0:1787782661.604595:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922337408 00000100:00100000:1.0:1787782661.604604:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922337408 00000100:00100000:1.0:1787782661.604627:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922337280 00000100:00100000:1.0:1787782661.604630:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922337280 00000100:00100000:1.0:1787782661.604670:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782661.604677:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ede50ea5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874625922337280:12345-0@lo:38: 00000100:00100000:1.0:1787782661.604862:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ede50ea5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874625922337280:12345-0@lo:38: Request processed in 185us (1589us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787782661.604870:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782661.604920:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787782661.604926:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a9a87131 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5880:x1874625922337408:12345-0@lo:502: 00000100:00100000:0.0:1787782661.605303:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787782661.605313:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000af3ca307 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787782661.605318:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787782661.605321:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d271ad9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625922337280:0@lo:38: 00000100:00100000:1.0:1787782661.605516:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a9a87131 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5880:x1874625922337408:12345-0@lo:502: Request processed in 590us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782661.605525:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787782661.608581:0:5880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000050a947f2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:5880:1874625922337408:0@lo:502: 00000040:00080000:0.0:1787782661.608640:0:5880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1787782661.608816:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787782661.608849:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787782661.608883:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 000000001b9742e9/0x6d98ed19b636dde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636de5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.608893:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 000000001b9742e9/0x6d98ed19b636dde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636de5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787782661.608942:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787782661.608945:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787782661.608946:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782661.608948:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782661.608949:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782661.608950:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782661.608951:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787782661.608953:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787782661.608954:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787782661.608956:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787782661.608957:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782661.608958:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787782661.608962:0:5831:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1787782661.608964:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787782661.608966:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787782661.608967:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782661.608968:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782661.608969:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782661.608970:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782661.608970:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787782661.608971:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787782661.608972:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787782661.608973:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787782661.608973:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782661.608974:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787782661.608999:0:5831:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787782661.609013:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042929c3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922337536:0@lo:253: 00000100:00100000:3.0:1787782661.609077:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782661.611554:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922337536 00000100:00100000:1.0:1787782661.611571:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922337536 00000100:00100000:1.0:1787782661.611622:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787782661.611631:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c512fe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5831:x1874625922337536:12345-0@lo:253: 20000000:01000000:1.0:1787782661.611668:0:5846:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787782661.611682:0:5846:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787782661.616529:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set 0000000072d798ea going to sleep for 11 seconds 20000000:01000000:3.0:1787782661.649552:0:5846:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787782661.649607:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787782661.649659:0:5867:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787782661.649664:0:5867:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787782661.649704:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000088b0817/0x6d98ed19b636dfa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782661.649831:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636dc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636dc2 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782661.649841:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000088b0817/0x6d98ed19b636dfa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782661.649879:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636dc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636dc2 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782661.649894:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636dc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636dc2 expref: 12 pid: 5846 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782661.649908:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f4ad912 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1874625922337664:0@lo:104: 00000100:00100000:2.0:1787782661.649971:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782661.650049:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 0000000092c72f69 going to sleep for 11 seconds 00000100:00100000:1.0:1787782661.650980:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922337664 00000100:00100000:1.0:1787782661.650991:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922337664 00000100:00100000:1.0:1787782661.651042:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782661.651050:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc5005ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+3:5867:x1874625922337664:12345-0@lo:104: 00010000:00010000:1.0:1787782661.651064:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: 00000000a3cdaed5/0x6d98ed19b636dc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636dc9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.651370:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787782661.651377:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc5005ad pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+3:5867:x1874625922337664:12345-0@lo:104: Request processed in 327us (1405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782661.651387:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787782661.651505:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782661.651521:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: 00000000a3cdaed5/0x6d98ed19b636dc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636dc9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.651528:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a3cdaed5 already unused, calling callback (000000008079dd3a) 10000000:00010000:3.0:1787782661.651531:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: 00000000a3cdaed5/0x6d98ed19b636dc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636dc9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.651539:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: 00000000a3cdaed5/0x6d98ed19b636dc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636dc9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782661.651545:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: 00000000a3cdaed5/0x6d98ed19b636dc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636dc9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782661.651550:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787782661.651583:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: 00000000a3cdaed5/0x6d98ed19b636dc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636dc9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.651594:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782661.651622:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: 00000000a3cdaed5/0x6d98ed19b636dc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636dc9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.651628:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: 00000000a3cdaed5/0x6d98ed19b636dc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636dc9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782661.651648:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782661.651650:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782661.651651:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782661.651695:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787782661.651709:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a75c1afd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922337792:0@lo:103: 00000100:00100000:3.0:1787782661.651745:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782661.653022:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922337792 00000100:00100000:1.0:1787782661.653033:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922337792 00010000:00010000:1.0:1787782661.653062:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636dc9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636dc2 expref: 13 pid: 5846 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782661.653115:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782661.653123:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000520b54ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:3304:x1874625922337792:12345-0@lo:103: 00010000:00010000:1.0:1787782661.653262:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782661.653269:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636dc9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636dc2 expref: 13 pid: 5846 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.653284:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636dc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636dc2 expref: 13 pid: 5846 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.653307:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000088b0817/0x6d98ed19b636dfa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.653315:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000088b0817/0x6d98ed19b636dfa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787782661.653333:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003669618s 00010000:00010000:1.0:1787782661.653337:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000088b0817/0x6d98ed19b636dfa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.653344:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000088b0817/0x6d98ed19b636dfa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.653352:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000088b0817/0x6d98ed19b636dfa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.653359:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000088b0817/0x6d98ed19b636dfa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.653364:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000088b0817 already unused, calling callback (00000000a7688c57) 00010000:00010000:1.0:1787782661.653368:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000088b0817/0x6d98ed19b636dfa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.653375:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000088b0817/0x6d98ed19b636dfa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.653454:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000088b0817/0x6d98ed19b636dfa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782661.653469:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782661.653530:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000520b54ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:3304:x1874625922337792:12345-0@lo:103: Request processed in 409us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782661.653537:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782661.653587:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a75c1afd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922337792:0@lo:103: 00010000:00010000:2.0:1787782661.656217:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636dc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636dc2 expref: 12 pid: 5846 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782661.656239:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f4ad912 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1874625922337664:0@lo:104: 00010000:00010000:2.0:1787782661.656263:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000088b0817/0x6d98ed19b636dfa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782661.656272:0:5867:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000088b0817/0x6d98ed19b636dfa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782661.656277:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000088b0817/0x6d98ed19b636dfa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782661.656295:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000088b0817/0x6d98ed19b636dfa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782661.662131:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c512fe9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+11:5831:x1874625922337536:12345-0@lo:253: Request processed in 50493us (53046us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782661.662219:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787782661.662316:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042929c3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:5831:1874625922337536:0@lo:253: 10000000:01000000:2.0:1787782661.662332:0:5831:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787782661.662335:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787782661.662337:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787782661.662339:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782661.662340:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782661.662341:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782661.662342:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782661.662344:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787782661.662345:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787782661.662346:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787782661.662347:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787782661.662349:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782661.662350:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787782661.662362:0:5831:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787782661.666050:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787782661.666914:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787782661.667298:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787782661.667578:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787782661.667778:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787782661.667955:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787782661.669015:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787782661.669355:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787782661.669614:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787782661.669787:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787782661.670034:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787782661.670652:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787782661.725060:0:5831:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787782661.767844:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787782661.768330:0:5886:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1787782661.771335:0:5885:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787782661.771342:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787782661.772055:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787782661.772411:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787782661.773348:0:5831:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787782661.773360:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787782661.773551:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787782661.774843:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787782661.776464:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787782661.776529:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787782661.776886:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787782661.777423:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787782661.783328:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787782661.783462:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787782661.783618:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787782661.783765:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787782661.783926:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787782661.784319:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787782661.784432:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787782661.784590:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787782661.784713:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787782661.784834:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787782661.784927:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787782661.785049:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787782661.785250:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787782661.785372:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787782661.785519:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787782661.785662:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787782661.785917:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787782661.786011:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787782661.786299:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787782661.786547:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787782661.786751:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787782661.786930:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787782661.787046:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787782661.787231:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787782661.787375:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787782661.787529:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787782661.787679:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787782661.787783:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787782661.789158:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787782661.789318:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787782661.789464:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787782661.789638:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787782661.789824:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787782661.844326:0:5886:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787782661.923052:0:5831:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787782661.923091:0:5831:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb0afc1c47988 00100000:10000000:3.0:1787782661.923117:0:5831:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787782661.924129:0:5831:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787782661.924146:0:5831:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787782661.924160:0:5831:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787782661.924185:0:5831:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1787782661.972563:0:5886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787782661.972632:0:5886:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787782661.972636:0:5886:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787782662.500836:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782663.522077:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782664.546175:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782665.574029:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787782666.510513:0:6128:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787782666.594334:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787782666.849272:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787782666.849285:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787782666.849288:0:36:0:(import.c:65:import_set_state_nolock()) 00000000af3ca307 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787782666.849304:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000af3ca307 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:0.0:1787782666.849326:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e109c91f x1874625922338048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787782666.849481:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787782666.849495:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d271ad9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922337920:0@lo:400: 00000100:00100000:0.0:1787782666.849575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782666.849640:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625922338048:0@lo:38: 00000100:00100000:0.0:1787782666.849667:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782666.849706:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922338048 00000100:00100000:0.0:1787782666.849713:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922338048 00000100:00100000:0.0:1787782666.849760:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787782666.849767:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002387c551 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874625922338048:12345-0@lo:38: 00010000:00080000:0.0:1787782666.849790:0:5853:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:0.0:1787782666.849827:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6d98ed19b636e01 00000004:00100000:0.0:1787782666.849869:0:5853:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787782666.849976:0:5853:0:(import.c:65:import_set_state_nolock()) 00000000dfb095cf : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787782666.850023:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002387c551 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625922338048:12345-0@lo:38: Request processed in 256us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782666.850030:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787782666.850085:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e109c91f x1874625922338048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787782676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787782666.850142:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787782666.850165:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787782666.850170:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787782666.850173:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000af3ca307 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787782666.850178:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625922338048:0@lo:38: 00000100:00100000:3.0:1787782666.852413:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922337920 00000100:00100000:3.0:1787782666.852427:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922337920 00000100:00100000:3.0:1787782666.852513:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787782666.852522:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000acf8fe1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+11:3307:x1874625922337920:12345-0@lo:400: 00000100:00100000:3.0:1787782666.852618:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000acf8fe1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+11:3307:x1874625922337920:12345-0@lo:400: Request processed in 97us (3043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782666.852625:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787782666.852708:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d271ad9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922337920:0@lo:400: 00010000:00010000:0.0:1787782667.619298:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787782667.873884:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787782667.873894:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c311846c800 from 3 10000000:01000000:0.0:1787782667.873899:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787782667.873948:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 00000000f64bac52/0x6d98ed19b636e08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782667.873962:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 00000000f64bac52/0x6d98ed19b636e08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782667.873973:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 00000000f64bac52/0x6d98ed19b636e08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782667.873999:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d271ad9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922338176:0@lo:101: 00000100:00100000:0.0:1787782667.874069:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782667.874155:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set 0000000097f3636a going to sleep for 11 seconds 00000100:00100000:3.0:1787782667.874297:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922338176 00000100:00100000:3.0:1787782667.874304:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922338176 00000100:00100000:3.0:1787782667.874343:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787782667.874350:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1b8aa47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+11:5848:x1874625922338176:12345-0@lo:101: 00010000:00010000:3.0:1787782667.874362:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782667.874376:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002e27ca2d/0x6d98ed19b636e0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636e08 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782667.874398:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002e27ca2d/0x6d98ed19b636e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636e08 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782667.874408:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002e27ca2d/0x6d98ed19b636e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636e08 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782667.874432:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002e27ca2d, rc 0) 00000100:00100000:3.0:1787782667.874481:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1b8aa47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5848:x1874625922338176:12345-0@lo:101: Request processed in 131us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782667.874488:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787782667.874810:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d271ad9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922338176:0@lo:101: 00010000:00010000:0.0:1787782667.874825:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 00000000f64bac52/0x6d98ed19b636e08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782667.874832:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 00000000f64bac52/0x6d98ed19b636e08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636e0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782667.874887:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d271ad9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922338304:0@lo:256: 00000100:00100000:0.0:1787782667.874917:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782667.874941:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set 0000000097f3636a going to sleep for 11 seconds 00000100:00100000:3.0:1787782667.875868:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922338304 00000100:00100000:3.0:1787782667.875877:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922338304 00000100:00100000:3.0:1787782667.875917:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787782667.875925:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002203aa16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5848:x1874625922338304:12345-0@lo:256: 20000000:01000000:3.0:1787782667.875943:0:5844:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787782667.875959:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787782667.875962:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787782667.876059:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002203aa16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5848:x1874625922338304:12345-0@lo:256: Request processed in 135us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782667.876067:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787782667.876151:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d271ad9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922338304:0@lo:256: 10000000:01000000:3.0:1787782667.876201:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787782667.876207:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: 00000000f64bac52/0x6d98ed19b636e08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782667.876215:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: 00000000f64bac52/0x6d98ed19b636e08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782668.643213:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782669.666949:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782670.692500:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782671.714962:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787782671.885784:0:6331:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf8b61730 20000000:00000080:1.0:1787782671.885811:0:6331:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c312947a800 uarg=0000000000000000 20000000:01000000:1.0:1787782671.885861:0:6331:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787782671.885873:0:6331:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787782671.885879:0:6331:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787782671.889605:0:6331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787782671.889640:0:6331:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787782671.915016:0:6331:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787782671.917417:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787782671.917530:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787782671.917583:0:6331:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787782671.917605:0:6331:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787782671.917622:0:6331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636e16 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782671.917640:0:6331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000051e5efc6/0x6d98ed19b636dd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636dd0 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782671.917649:0:6331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636e16 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782671.917685:0:6331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000051e5efc6/0x6d98ed19b636dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636dd0 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782671.917715:0:6331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000051e5efc6/0x6d98ed19b636dd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636dd0 expref: 11 pid: 5846 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782671.917731:0:6331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6331:1874625922338432:0@lo:104: 00000100:00100000:0.0:1787782671.917803:0:6331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782671.917874:0:6331:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fe87980b going to sleep for 11 seconds 00000100:00100000:1.0:1787782671.920625:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922338432 00000100:00100000:1.0:1787782671.920653:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922338432 00000100:00100000:1.0:1787782671.920765:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787782671.920778:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1329302 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+3:6331:x1874625922338432:12345-0@lo:104: 00010000:00010000:1.0:1787782671.920808:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: 00000000bc5ecbb1/0x6d98ed19b636dd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636dd7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782671.921018:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787782671.921024:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1329302 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+3:6331:x1874625922338432:12345-0@lo:104: Request processed in 250us (3221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782671.921034:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787782671.921171:0:6331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e109c91f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6331:1874625922338432:0@lo:104: 00010000:00010000:2.0:1787782671.921216:0:6331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636e16 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782671.921419:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782671.921427:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: 00000000bc5ecbb1/0x6d98ed19b636dd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636dd7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782671.921435:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bc5ecbb1 already unused, calling callback (000000008079dd3a) 10000000:00010000:3.0:1787782671.921455:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: 00000000bc5ecbb1/0x6d98ed19b636dd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636dd7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782671.921465:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: 00000000bc5ecbb1/0x6d98ed19b636dd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636dd7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782671.921472:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: 00000000bc5ecbb1/0x6d98ed19b636dd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636dd7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782671.921479:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787782671.921549:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: 00000000bc5ecbb1/0x6d98ed19b636dd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636dd7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782671.921557:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782671.921594:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: 00000000bc5ecbb1/0x6d98ed19b636dd0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636dd7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782671.921601:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: 00000000bc5ecbb1/0x6d98ed19b636dd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636dd7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782671.921619:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782671.921621:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782671.921623:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782671.921651:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787782671.921673:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cdea4ca2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922338560:0@lo:103: 00000100:00100000:3.0:1787782671.921779:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782671.922048:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922338560 00000100:00100000:1.0:1787782671.922058:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922338560 00010000:00010000:1.0:1787782671.922091:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000051e5efc6/0x6d98ed19b636dd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636dd0 expref: 12 pid: 5846 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782671.922155:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787782671.922170:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8d38299 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+12:3306:x1874625922338560:12345-0@lo:103: 00010000:00010000:1.0:1787782671.922188:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782671.922195:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000051e5efc6/0x6d98ed19b636dd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636dd0 expref: 12 pid: 5846 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782671.922210:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000051e5efc6/0x6d98ed19b636dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636dd0 expref: 12 pid: 5846 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782671.922231:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000051e5efc6/0x6d98ed19b636dd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636dd0 expref: 12 pid: 5846 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782671.922256:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636e16 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782671.922267:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636e16 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782671.922664:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636e16 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782671.922692:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636e16 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782671.922708:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636e16 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782671.922714:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636e16 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782671.922720:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a67b85d7 already unused, calling callback (00000000a7688c57) 00010000:00010000:0.0:1787782671.922724:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636e16 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782671.922731:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636e16 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782671.933962:0:6331:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636e16 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782671.933983:0:6331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636e16 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782671.934333:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636e16 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782671.934345:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a67b85d7/0x6d98ed19b636e16 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782671.934370:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782671.934487:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8d38299 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+11:3306:x1874625922338560:12345-0@lo:103: Request processed in 12318us (12706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782671.934501:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787782671.935211:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cdea4ca2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922338560:0@lo:103: 00000100:00100000:0.0:1787782671.970223:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787782671.970253:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de4d59dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625922338688:0@lo:400: 00000100:00100000:0.0:1787782671.970328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782671.970413:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922338688 00000100:00100000:1.0:1787782671.970429:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922338688 00000100:00100000:1.0:1787782671.970485:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782671.970493:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3c5e2cd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625922338688:12345-0@lo:400: 00000100:00100000:1.0:1787782671.970557:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3c5e2cd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625922338688:12345-0@lo:400: Request processed in 65us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782671.970573:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787782671.970660:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000de4d59dd x1874625922338688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782671.970674:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de4d59dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625922338688:0@lo:400: 00010000:00010000:0.0:1787782672.737812:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782673.764839:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782674.794981:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782675.815806:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787782676.578441:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787782676.578448:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c311846c800 from 1 10000000:01000000:2.0:1787782676.578452:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787782676.578494:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: 0000000009c6d090/0x6d98ed19b636e1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782676.578503:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: 0000000009c6d090/0x6d98ed19b636e1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782676.578510:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: 0000000009c6d090/0x6d98ed19b636e1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782676.578528:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de4d59dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922338816:0@lo:101: 00000100:00100000:2.0:1787782676.578611:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782676.578667:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df13b7a6 going to sleep for 11 seconds 00000100:00100000:1.0:1787782676.578761:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922338816 00000100:00100000:1.0:1787782676.578770:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922338816 00000100:00100000:1.0:1787782676.578936:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787782676.579014:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf5a19e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+11:5848:x1874625922338816:12345-0@lo:101: 00010000:00010000:1.0:1787782676.579029:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782676.579044:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007cd65433/0x6d98ed19b636e24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636e1d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782676.579067:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007cd65433/0x6d98ed19b636e24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636e1d expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782676.579076:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007cd65433/0x6d98ed19b636e24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636e1d expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782676.579085:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007cd65433, rc 0) 00000100:00100000:1.0:1787782676.579159:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf5a19e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5848:x1874625922338816:12345-0@lo:101: Request processed in 214us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782676.579166:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787782676.579255:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de4d59dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922338816:0@lo:101: 00010000:00010000:2.0:1787782676.579271:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: 0000000009c6d090/0x6d98ed19b636e1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e24 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782676.579280:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: 0000000009c6d090/0x6d98ed19b636e1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636e24 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782676.579334:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000de4d59dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922338944:0@lo:501: 00000100:00100000:2.0:1787782676.579375:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782676.579477:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set 00000000df13b7a6 going to sleep for 11 seconds 00000100:00100000:1.0:1787782676.579508:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922338944 00000100:00100000:1.0:1787782676.579512:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922338944 00000100:00100000:1.0:1787782676.579567:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787782676.579575:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be521a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5848:x1874625922338944:12345-0@lo:501: 00000100:00100000:1.0:1787782676.579931:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be521a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5848:x1874625922338944:12345-0@lo:501: Request processed in 357us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782676.580072:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787782676.580146:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000de4d59dd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922338944:0@lo:501: 00000100:00100000:1.0:1787782676.580181:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ad1b50d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922339072:0@lo:503: 00000100:00100000:1.0:1787782676.580215:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782676.580228:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ec319fa7 going to sleep for 11 seconds 00000100:00100000:1.0:1787782676.580238:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922339072 00000100:00100000:1.0:1787782676.580241:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922339072 00000100:00100000:1.0:1787782676.580256:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787782676.580261:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007253775e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5848:x1874625922339072:12345-0@lo:503: 00000100:00100000:1.0:1787782676.580392:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007253775e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5848:x1874625922339072:12345-0@lo:503: Request processed in 130us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782676.580398:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787782676.580428:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ad1b50d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922339072:0@lo:503: 00000100:00100000:1.0:1787782676.580634:0:6564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ad1b50d pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:6564:1874625922339200:0@lo:502: 00000100:00100000:1.0:1787782676.580676:0:6564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782676.580693:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922339200 00000100:00100000:1.0:1787782676.580697:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922339200 00000100:00100000:1.0:1787782676.580711:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787782676.580715:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be1408d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6564:x1874625922339200:12345-0@lo:502: 00000100:00100000:0.0:1787782676.580922:0:6564:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ec319fa7 going to sleep for 11 seconds 00000100:00100000:1.0:1787782676.581565:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be1408d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6564:x1874625922339200:12345-0@lo:502: Request processed in 848us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782676.581574:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787782676.581916:0:6564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ad1b50d pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:6564:1874625922339200:0@lo:502: 00000020:01000000:2.0:1787782676.581944:0:6564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782676.581954:0:6564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782676.581956:0:6564:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787782676.581964:0:6564:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c311846c800 00000020:00000080:2.0:1787782676.581966:0:6564:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787782676.582009:0:6564:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:6564:1874625922339328:0@lo:502: 00000100:00100000:2.0:1787782676.582046:0:6564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782676.582148:0:6564:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102e7b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787782676.585640:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922339328 00000100:00100000:3.0:1787782676.585666:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922339328 00000100:00100000:3.0:1787782676.585756:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787782676.585767:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6564:x1874625922339328:12345-0@lo:502: 00000100:00100000:3.0:1787782676.586083:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6564:x1874625922339328:12345-0@lo:502: Request processed in 317us (4035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782676.586091:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787782676.586477:0:6564:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:6564:1874625922339328:0@lo:502: 00000020:01000000:3.0:1787782676.586513:0:6564:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782676.586522:0:6564:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782676.586524:0:6564:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787782676.586528:0:6564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787782676.587738:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787782676.587767:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787782676.587780:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b636e1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e24 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782676.587793:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b636e1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e24 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782676.841549:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782677.089285:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787782677.089311:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625922339456:0@lo:400: 00000100:00100000:3.0:1787782677.089380:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782677.089709:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922339456 00000100:00100000:2.0:1787782677.089718:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922339456 00000100:00100000:2.0:1787782677.089771:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787782677.089781:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625922339456:12345-0@lo:400: 00000100:00100000:2.0:1787782677.089846:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625922339456:12345-0@lo:400: Request processed in 66us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782677.089854:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787782677.089925:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c3119e88780 x1874625922339456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782677.089940:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625922339456:0@lo:400: 00010000:00010000:1.0:1787782677.861669:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782678.885059:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787782679.241319:0:6694:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787782679.241323:0:6694:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787782679.241472:0:6694:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c3129b5d800 00000020:01000004:3.0:1787782679.241491:0:6694:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787782679.241507:0:6694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787782679.241525:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8c313cd619b8) 00000020:00000080:3.0:1787782679.241544:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787782679.299561:0:6694:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787782679.299853:0:6694:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787782679.339989:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787782679.347382:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787782679.347419:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787782679.347482:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787782679.347510:0:6694:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787782679.349365:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787782679.349377:0:6694:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787782679.349390:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6d98ed19b636e32 00000020:01000004:2.0:1787782679.349398:0:6694:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787782679.349418:0:6694:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.115@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787782679.349422:0:6694:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787782679.349428:0:6694:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787782679.349432:0:6694:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787782679.349446:0:6694:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8c3108298000) 00000020:00000080:2.0:1787782679.349455:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787782679.352976:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782679.353232:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787782679.353240:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787782679.355452:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787782679.355465:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787782679.357542:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787782679.357555:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787782679.364816:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787782679.365027:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787782679.365034:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787782679.368134:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787782679.368158:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787782679.426081:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782679.426705:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787782679.426713:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787782679.428785:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787782679.428797:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787782679.443927:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787782679.443952:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787782679.447905:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782679.448388:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787782679.448404:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787782679.449411:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787782679.449420:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787782679.579924:0:6694:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787782679.580388:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787782679.580395:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787782679.583896:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787782679.583926:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787782679.586770:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787782679.586818:0:6694:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787782679.586825:0:6694:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787782679.638696:0:6694:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787782679.638772:0:6694:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.115@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1787782679.638777:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787782679.638779:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787782679.638780:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782679.638781:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782679.638795:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782679.638797:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782679.638798:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782679.638799:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787782679.638801:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787782679.638803:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782679.638804:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787782679.638808:0:6694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1787782679.638811:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787782679.638812:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787782679.638813:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782679.638814:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782679.638815:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782679.638816:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782679.638817:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782679.638818:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787782679.638819:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787782679.638820:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782679.638821:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787782679.638872:0:6694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787782679.638913:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922339584:0@lo:253: 00000100:00100000:2.0:1787782679.639040:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782679.639383:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31346c5180 going to sleep for 11 seconds 00000100:00100000:1.0:1787782679.639526:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922339584 00000100:00100000:1.0:1787782679.639546:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922339584 00000100:00100000:1.0:1787782679.639704:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787782679.639739:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6694:x1874625922339584:12345-0@lo:253: 20000000:01000000:1.0:1787782679.639794:0:5844:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787782679.639823:0:5844:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787782679.639847:0:5844:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787782679.639870:0:5844:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787782679.642086:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782679.642619:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787782679.642658:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787782679.642767:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787782679.642777:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787782679.642872:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787782679.642993:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787782679.643830:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787782679.643867:0:5844:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.115@tcp 20000000:01000000:1.0:1787782679.643880:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.115@tcp (null) (null) (null) 00000040:00080000:1.0:1787782679.643941:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787782679.643950:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787782679.644238:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787782679.644309:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.115@tcp (null) (null) 00000040:00080000:1.0:1787782679.644395:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787782679.644421:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787782679.644504:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787782679.646342:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1787782679.648004:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787782679.648058:0:5844:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.115@tcp 20000000:01000000:3.0:1787782679.648061:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.115@tcp (null) (null) (null) 00000040:00080000:3.0:1787782679.648305:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787782679.648332:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787782679.648396:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787782679.648456:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.115@tcp (null) (null) 00000040:00080000:3.0:1787782679.648561:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787782679.648583:0:5844:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787782679.648670:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787782679.648744:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787782679.648762:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787782679.648765:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787782679.648768:0:5844:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787782679.648779:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787782679.648797:0:5844:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787782679.648860:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787782679.648863:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787782679.650064:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1787782679.651496:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1787782679.651620:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1787782679.651771:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1787782679.651788:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787782679.651791:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787782679.652933:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787782679.652996:0:6710:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787782679.653049:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787782679.654550:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787782679.654602:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787782679.654653:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787782679.654667:0:5844:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787782679.654669:0:5844:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787782679.655545:0:6711:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787782679.655598:0:6711:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787782679.655671:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1787782679.656675:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1787782679.656722:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1787782679.656816:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1787782679.656833:0:5844:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787782679.656836:0:5844:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787782679.656845:0:5844:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787782679.656865:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c31029f5000/0x6d98ed19b636e40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.656886:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31029f5e00/0x6d98ed19b636d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636d52 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.656906:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31029f4800/0x6d98ed19b636d75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636d6e expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.656913:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31421fc000/0x6d98ed19b636de5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636dde expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.656922:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c31029f5000/0x6d98ed19b636e40 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.656967:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31421fc000/0x6d98ed19b636de5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636dde expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.656982:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c31421fc000/0x6d98ed19b636de5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636dde expref: 12 pid: 5846 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782679.656997:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187aa580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5844:1874625922339712:0@lo:104: 00000100:00100000:3.0:1787782679.657077:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787782679.657184:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31029f4800/0x6d98ed19b636d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636d6e expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.657194:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c31029f4800/0x6d98ed19b636d75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636d6e expref: 12 pid: 5845 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782679.657202:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187a8780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5844:1874625922339840:0@lo:104: 00000100:00100000:3.0:1787782679.657225:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782679.657257:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922339712 00000100:00100000:3.0:1787782679.657263:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922339712 00000100:00100000:3.0:1787782679.657368:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922339840 00000100:00100000:3.0:1787782679.657372:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922339840 00000100:00100000:3.0:1787782679.657528:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787782679.657538:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+4:5844:x1874625922339712:12345-0@lo:104: 00010000:00010000:3.0:1787782679.657551:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c3100030200/0x6d98ed19b636dde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636de5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.657612:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787782679.657619:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+4:5844:x1874625922339712:12345-0@lo:104: Request processed in 83us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782679.657626:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787782679.657653:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782679.657660:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+3:5844:x1874625922339840:12345-0@lo:104: 00010000:00010000:3.0:1787782679.657667:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636d6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636d75 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.657700:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787782679.657705:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+3:5844:x1874625922339840:12345-0@lo:104: Request processed in 47us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782679.657711:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787782679.657730:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787782679.657732:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782679.657736:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3100030200/0x6d98ed19b636dde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636de5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.657743:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3100030200 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782679.657747:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3100030200/0x6d98ed19b636dde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636de5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.657755:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3100030200/0x6d98ed19b636dde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636de5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782679.657772:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3100030200/0x6d98ed19b636dde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636de5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782679.657778:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787782679.657919:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782679.657949:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636d6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636d75 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.658144:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31029f5e00/0x6d98ed19b636d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636d52 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.658165:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c31029f5e00/0x6d98ed19b636d59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636d52 expref: 12 pid: 5845 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782679.658186:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5844:1874625922340096:0@lo:104: 00000100:00100000:2.0:1787782679.658220:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782679.658244:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c313cb4d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782679.658266:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187aa580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5844:1874625922339712:0@lo:104: 00000100:00100000:2.0:1787782679.658276:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187a8780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5844:1874625922339840:0@lo:104: 00000100:00100000:2.0:1787782679.658321:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922340096 00000100:00100000:2.0:1787782679.658325:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922340096 00000100:00100000:2.0:1787782679.658352:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787782679.658358:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+3:5844:x1874625922340096:12345-0@lo:104: 00010000:00010000:0.0:1787782679.658849:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782679.658853:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782679.666882:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3100031200 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:1.0:1787782679.666894:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636d6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636d75 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.666915:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636d75 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782679.666931:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636d6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636d75 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782679.666938:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787782679.667009:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636d6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636d75 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.667024:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787782679.667042:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636d6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636d75 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.667056:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636d6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636d75 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.667074:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782679.667076:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782679.667078:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782679.667278:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922340224:0@lo:103: 00000100:00100000:1.0:1787782679.667390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782679.667737:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922340224 00000100:00100000:1.0:1787782679.667744:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922340224 00010000:00010000:1.0:1787782679.667803:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31029f4800/0x6d98ed19b636d75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636d6e expref: 13 pid: 5845 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782679.667846:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787782679.667866:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+13:3306:x1874625922340224:12345-0@lo:103: 00010000:00010000:1.0:1787782679.667891:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782679.667898:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31029f4800/0x6d98ed19b636d75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636d6e expref: 13 pid: 5845 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.667909:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31029f4800/0x6d98ed19b636d75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636d6e expref: 13 pid: 5845 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.667939:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31029f4800/0x6d98ed19b636d75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636d6e expref: 13 pid: 5845 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.667968:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782679.668048:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+12:3306:x1874625922340224:12345-0@lo:103: Request processed in 184us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782679.668055:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787782679.668152:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922340224:0@lo:103: 00010000:00010000:2.0:1787782679.682892:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c3100030a00/0x6d98ed19b636d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636d59 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.683401:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787782679.683426:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+3:5844:x1874625922340096:12345-0@lo:104: Request processed in 25051us (25188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782679.683438:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787782679.683544:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3100030200/0x6d98ed19b636dde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636de5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.683564:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782679.683702:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3100030200/0x6d98ed19b636dde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636de5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.683711:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3100030200/0x6d98ed19b636dde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636de5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.683737:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782679.683742:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3100030a00/0x6d98ed19b636d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636d59 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.683748:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3100030a00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782679.683752:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3100030a00/0x6d98ed19b636d52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636d59 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.683770:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3100030a00/0x6d98ed19b636d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636d59 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782679.683777:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3100030a00/0x6d98ed19b636d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636d59 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782679.683783:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787782679.683867:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3100030a00/0x6d98ed19b636d52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636d59 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.683888:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782679.683929:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3100030a00/0x6d98ed19b636d52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636d59 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.683936:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3100030a00/0x6d98ed19b636d52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636d59 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.683952:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782679.683955:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782679.683956:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782679.683984:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922340352:0@lo:103: 00000100:00100000:3.0:1787782679.684041:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782679.684441:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922339968:0@lo:103: 00000100:00100000:1.0:1787782679.684493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782679.685344:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922340352 00000100:00100000:1.0:1787782679.685354:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922340352 00010000:00010000:1.0:1787782679.685393:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31029f5e00/0x6d98ed19b636d59 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636d52 expref: 12 pid: 5845 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782679.685427:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922339968 00000100:00100000:1.0:1787782679.685430:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922339968 00010000:00010000:1.0:1787782679.685442:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31421fc000/0x6d98ed19b636de5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636dde expref: 13 pid: 5846 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782679.685471:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787782679.685481:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187ab840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:3304:x1874625922340352:12345-0@lo:103: 00010000:00010000:1.0:1787782679.685494:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782679.685499:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31029f5e00/0x6d98ed19b636d59 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636d52 expref: 13 pid: 5845 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.685509:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31029f5e00/0x6d98ed19b636d59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636d52 expref: 13 pid: 5845 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.685528:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782679.685657:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187ab840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:3304:x1874625922340352:12345-0@lo:103: Request processed in 176us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782679.685664:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787782679.685683:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787782679.685689:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:3307:x1874625922339968:12345-0@lo:103: 00010000:00010000:1.0:1787782679.685697:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782679.685701:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31421fc000/0x6d98ed19b636de5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636dde expref: 12 pid: 5846 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.685710:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31421fc000/0x6d98ed19b636de5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636dde expref: 12 pid: 5846 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.685720:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31421fc000/0x6d98ed19b636de5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636dde expref: 12 pid: 5846 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.685735:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c31029f5000/0x6d98ed19b636e40 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.685752:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31029f5000/0x6d98ed19b636e40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.685766:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c31029f5000/0x6d98ed19b636e40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.685773:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c31029f5000/0x6d98ed19b636e40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.685779:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c31029f5000/0x6d98ed19b636e40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.685786:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c31029f5000/0x6d98ed19b636e40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.685792:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f5000 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782679.685796:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c31029f5000/0x6d98ed19b636e40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.685804:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c31029f5000/0x6d98ed19b636e40 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.685813:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c31029f5000/0x6d98ed19b636e40 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.685822:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782679.685852:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+11:3307:x1874625922339968:12345-0@lo:103: Request processed in 163us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782679.685858:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787782679.685900:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922340352:0@lo:103: 00000100:00100000:1.0:1787782679.685964:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922339968:0@lo:103: 00010000:00010000:1.0:1787782679.685992:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31029f5e00/0x6d98ed19b636d59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636d52 expref: 10 pid: 5845 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782679.686002:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5844:1874625922340096:0@lo:104: 00010000:00010000:1.0:1787782679.686023:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c31029f5000/0x6d98ed19b636e40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.686032:0:5844:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c31029f5000/0x6d98ed19b636e40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.686038:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c31029f5000/0x6d98ed19b636e40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.686044:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31029f5000/0x6d98ed19b636e40 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787782679.686057:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1787782679.686571:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782679.787768:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+9:6694:x1874625922339584:12345-0@lo:253: Request processed in 148037us (148710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782679.787788:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787782679.788000:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922339584:0@lo:253: 10000000:01000000:2.0:1787782679.788024:0:6694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787782679.788029:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787782679.788031:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787782679.788033:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782679.788035:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787782679.788036:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782679.788037:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782679.788060:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782679.788062:0:6694:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787782679.788064:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782679.788066:0:6694:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787782679.788123:0:6694:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c3129b5d800 from lustre-OST0000 10000000:01000000:2.0:1787782679.788168:0:6694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787782679.788172:0:6694:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787782679.788316:0:6694:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c31091e8000 local copy 10000000:01000000:2.0:1787782679.788321:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787782679.788378:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.788393:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.788406:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782679.788432:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922340480:0@lo:101: 00000100:00100000:2.0:1787782679.788478:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782679.788674:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31346c5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782679.788814:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922340480 00000100:00100000:0.0:1787782679.788823:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922340480 00000100:00100000:0.0:1787782679.788953:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787782679.788964:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+9:6694:x1874625922340480:12345-0@lo:101: 00010000:00010000:0.0:1787782679.788980:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782679.788997:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3100031200/0x6d98ed19b636e4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636e47 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782679.789026:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3100031200/0x6d98ed19b636e4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636e47 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782679.789052:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3100031200/0x6d98ed19b636e4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636e47 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782679.789064:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3100031200, rc 0) 00000100:00100000:0.0:1787782679.789129:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+10:6694:x1874625922340480:12345-0@lo:101: Request processed in 167us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782679.789136:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787782679.789231:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8a580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922340480:0@lo:101: 00010000:00010000:1.0:1787782679.789249:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6d98ed19b636e4e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.789260:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6d98ed19b636e4e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782679.789434:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922340608:0@lo:501: 00000100:00100000:1.0:1787782679.789471:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782679.791767:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312a249000 going to sleep for 11 seconds 00000100:00100000:2.0:1787782679.791887:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922340608 00000100:00100000:2.0:1787782679.791902:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922340608 00000100:00100000:2.0:1787782679.791972:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787782679.791988:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+10:6694:x1874625922340608:12345-0@lo:501: 00000100:00100000:2.0:1787782679.793032:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+10:6694:x1874625922340608:12345-0@lo:501: Request processed in 1040us (3553us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787782679.793045:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787782679.793389:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922340608:0@lo:501: 10000000:01000000:1.0:1787782679.793429:0:6694:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787782679.793485:0:6694:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787782679.793497:0:6694:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6d98ed19b636e4e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.793512:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6d98ed19b636e4e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.793522:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6d98ed19b636e4e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.793666:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787782679.793708:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c3129b5d800 10000000:01000000:1.0:1787782679.793715:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787782679.793723:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8c31091e8000 10000000:01000000:1.0:1787782679.793725:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787782679.793729:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8c31091e8000 from 1 10000000:01000000:1.0:1787782679.793732:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787782679.793779:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fc000/0x6d98ed19b636e55 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.793789:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31421fc000/0x6d98ed19b636e55 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.793802:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31421fc000/0x6d98ed19b636e55 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782679.793824:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922340736:0@lo:101: 00000100:00100000:1.0:1787782679.793886:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782679.793950:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312a2493c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782679.794030:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922340736 00000100:00100000:0.0:1787782679.794038:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922340736 00000100:00100000:0.0:1787782679.794089:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787782679.794126:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+10:6694:x1874625922340736:12345-0@lo:101: 00010000:00010000:0.0:1787782679.794141:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782679.794159:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3100030a00/0x6d98ed19b636e5c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636e55 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782679.794200:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3100030a00/0x6d98ed19b636e5c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636e55 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782679.794212:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3100030a00/0x6d98ed19b636e5c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636e55 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782679.794222:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3100030a00, rc 0) 00000100:00100000:0.0:1787782679.794257:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+11:6694:x1874625922340736:12345-0@lo:101: Request processed in 134us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782679.794264:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787782679.794462:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922340736:0@lo:101: 00010000:00010000:3.0:1787782679.794480:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31421fc000/0x6d98ed19b636e55 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e5c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.794490:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31421fc000/0x6d98ed19b636e55 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636e5c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782679.794508:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787782679.794522:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fc000/0x6d98ed19b636e55 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e5c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.794530:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31421fc000/0x6d98ed19b636e55 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e5c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782679.794537:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787782679.794548:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787782679.794552:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787782679.794555:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787782679.794640:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31029f5600/0x6d98ed19b636e63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.794648:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31029f5600/0x6d98ed19b636e63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.794656:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31029f5600/0x6d98ed19b636e63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782679.794669:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187abc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922340864:0@lo:101: 00000100:00100000:3.0:1787782679.794697:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782679.794725:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c313cb4de40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782679.794807:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922340864 00000100:00100000:0.0:1787782679.794811:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922340864 00000100:00100000:0.0:1787782679.794839:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787782679.794851:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+11:6694:x1874625922340864:12345-0@lo:101: 00010000:00010000:0.0:1787782679.794858:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782679.794866:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3100030200/0x6d98ed19b636e6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636e63 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782679.794880:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3100030200/0x6d98ed19b636e6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636e63 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782679.794889:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3100030200/0x6d98ed19b636e6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636e63 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782679.794896:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3100030200, rc 0) 00000100:00100000:0.0:1787782679.794934:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6694:x1874625922340864:12345-0@lo:101: Request processed in 83us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782679.794940:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787782679.795013:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187abc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922340864:0@lo:101: 00010000:00010000:1.0:1787782679.795024:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31029f5600/0x6d98ed19b636e63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e6a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.795032:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31029f5600/0x6d98ed19b636e63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636e6a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782679.795169:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922340992:0@lo:501: 00000100:00100000:1.0:1787782679.795313:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782679.795334:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312a249e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782679.795397:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922340992 00000100:00100000:0.0:1787782679.795402:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922340992 00000100:00100000:0.0:1787782679.795433:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787782679.795440:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6694:x1874625922340992:12345-0@lo:501: 00000100:00100000:0.0:1787782679.795826:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6694:x1874625922340992:12345-0@lo:501: Request processed in 386us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782679.795834:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787782679.795964:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922340992:0@lo:501: 00000100:00100000:1.0:1787782679.795999:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922341120:0@lo:503: 00000100:00100000:1.0:1787782679.796039:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782679.796239:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312a249e40 going to sleep for 11 seconds 00010000:00010000:2.0:1787782679.797366:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782679.797383:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6d98ed19b636e4e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.797423:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1e00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:2.0:1787782679.797429:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6d98ed19b636e4e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.797439:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x6d98ed19b636e4e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782679.797447:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x6d98ed19b636e4e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782679.797453:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787782679.797493:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d98ed19b636e4e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.797500:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782679.797529:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d98ed19b636e4e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.797537:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d98ed19b636e4e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.797573:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782679.797575:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782679.797576:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782679.797596:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787782679.797622:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922341248:0@lo:103: 00000100:00100000:2.0:1787782679.797889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782679.797967:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922341248 00000100:00100000:2.0:1787782679.797977:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922341248 00000100:00100000:2.0:1787782679.798055:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782679.798064:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e89680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:3304:x1874625922341248:12345-0@lo:103: 00010000:00010000:2.0:1787782679.798079:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782679.798137:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3100031200/0x6d98ed19b636e4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d98ed19b636e47 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.798155:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782679.798201:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e89680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+11:3304:x1874625922341248:12345-0@lo:103: Request processed in 138us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782679.798209:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782679.798256:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922341248:0@lo:103: 00000100:00100000:0.0:1787782679.798863:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922341120 00000100:00100000:0.0:1787782679.798870:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922341120 00000100:00100000:0.0:1787782679.799026:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787782679.799034:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+11:6694:x1874625922341120:12345-0@lo:503: 00000100:00100000:0.0:1787782679.800997:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+11:6694:x1874625922341120:12345-0@lo:503: Request processed in 1954us (4948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782679.801031:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787782679.802594:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922341120:0@lo:503: 00000040:00080000:2.0:1787782679.803001:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787782679.803139:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922341376:0@lo:502: 00000100:00100000:2.0:1787782679.803221:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782679.803277:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31346c5780 going to sleep for 11 seconds 00000100:00100000:3.0:1787782679.804012:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922341376 00000100:00100000:3.0:1787782679.804023:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922341376 00000100:00100000:3.0:1787782679.804087:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787782679.804117:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+11:6694:x1874625922341376:12345-0@lo:502: 00000100:00100000:3.0:1787782679.804412:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+11:6694:x1874625922341376:12345-0@lo:502: Request processed in 314us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782679.804422:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787782679.807088:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922341376:0@lo:502: 00000040:00080000:2.0:1787782679.807936:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787782679.808009:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787782679.808059:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787782679.808386:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787782679.808430:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787782679.808464:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787782679.808525:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922341504:0@lo:502: 00000100:00100000:2.0:1787782679.809019:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782679.809132:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31346c5780 going to sleep for 11 seconds 00000100:00100000:1.0:1787782679.809310:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922341504 00000100:00100000:1.0:1787782679.809322:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922341504 00000100:00100000:1.0:1787782679.809399:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787782679.809411:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+11:6694:x1874625922341504:12345-0@lo:502: 00000100:00100000:1.0:1787782679.809806:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+11:6694:x1874625922341504:12345-0@lo:502: Request processed in 396us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782679.809815:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787782679.809934:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8bc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922341504:0@lo:502: 00000040:00080000:0.0:1787782679.810067:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787782679.810082:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787782679.811033:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787782679.811042:0:6713:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787782679.811049:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782679.811052:0:6713:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787782679.811057:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787782679.811073:0:6713:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8c311841cd28) 00000020:00000080:0.0:1787782679.811124:0:6713:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787782679.811131:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787782679.811266:0:6713:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c3129b5d800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787782679.811275:0:6713:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787782679.811281:0:6713:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6d98ed19b636e78 00010000:00010000:1.0:1787782679.818044:0:6713:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1787782679.819356:0:6713:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787782679.821713:0:6713:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787782679.822037:0:6713:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787782679.832371:0:6713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787782679.832760:0:6713:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787782679.841983:0:6713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787782679.841998:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787782679.842005:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782679.842007:0:6713:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787782679.842011:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787782679.842015:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782679.842016:0:6713:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787782679.842020:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787782679.842022:0:6713:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787782679.842338:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787782679.842342:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782679.842344:0:6713:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787782679.842347:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787782679.845731:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787782679.845782:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787782679.845798:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31029f5600/0x6d98ed19b636e63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e6a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.845811:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31029f5600/0x6d98ed19b636e63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e6a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782679.845836:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3129b5d800 from 1 10000000:01000000:3.0:1787782679.845838:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787782679.845877:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31029f5400/0x6d98ed19b636e7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.845885:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31029f5400/0x6d98ed19b636e7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.845897:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31029f5400/0x6d98ed19b636e7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782679.845922:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187abc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922341632:0@lo:101: 00000100:00100000:3.0:1787782679.846000:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782679.846055:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c313cb4d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782679.846074:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922341632 00000100:00100000:0.0:1787782679.846088:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922341632 00000100:00100000:0.0:1787782679.846168:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787782679.846186:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+11:6694:x1874625922341632:12345-0@lo:101: 00010000:00010000:0.0:1787782679.846200:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782679.846213:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3100031c00/0x6d98ed19b636e86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636e7f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782679.846238:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3100031c00/0x6d98ed19b636e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636e7f expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782679.846248:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3100031c00/0x6d98ed19b636e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636e7f expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782679.846257:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3100031c00, rc 0) 00000100:00100000:0.0:1787782679.846307:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6694:x1874625922341632:12345-0@lo:101: Request processed in 131us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782679.846314:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787782679.846822:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187abc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922341632:0@lo:101: 00010000:00010000:3.0:1787782679.846837:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31029f5400/0x6d98ed19b636e7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e86 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.846845:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31029f5400/0x6d98ed19b636e7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636e86 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782679.846941:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187abc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922341760:0@lo:501: 00000100:00100000:3.0:1787782679.846967:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782679.846999:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c313cb4d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782679.847136:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922341760 00000100:00100000:0.0:1787782679.847149:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922341760 00000100:00100000:0.0:1787782679.847456:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787782679.847465:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6694:x1874625922341760:12345-0@lo:501: 00000100:00100000:0.0:1787782679.847743:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6694:x1874625922341760:12345-0@lo:501: Request processed in 278us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782679.847751:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787782679.849040:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187abc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922341760:0@lo:501: 00000100:00100000:1.0:1787782679.849121:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922341888:0@lo:503: 00000100:00100000:1.0:1787782679.849174:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782679.852521:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312a2493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782679.854478:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922341888 00000100:00100000:3.0:1787782679.854496:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922341888 00000100:00100000:3.0:1787782679.854570:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787782679.854579:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6694:x1874625922341888:12345-0@lo:503: 00000100:00100000:3.0:1787782679.855551:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6694:x1874625922341888:12345-0@lo:503: Request processed in 970us (6372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782679.855561:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787782679.855665:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922341888:0@lo:503: 00000040:00080000:1.0:1787782679.856727:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787782679.856829:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922342016:0@lo:502: 00000100:00100000:1.0:1787782679.856892:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782679.856971:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312a2493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782679.857029:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922342016 00000100:00100000:3.0:1787782679.857035:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922342016 00000100:00100000:3.0:1787782679.857341:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787782679.857350:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6694:x1874625922342016:12345-0@lo:502: 00000100:00100000:3.0:1787782679.857614:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6694:x1874625922342016:12345-0@lo:502: Request processed in 264us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782679.857622:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787782679.857699:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922342016:0@lo:502: 00000040:00080000:1.0:1787782679.857953:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787782679.858001:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787782679.858028:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922342144:0@lo:502: 00000100:00100000:1.0:1787782679.858064:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782679.858595:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312a2493c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782679.858681:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922342144 00000100:00100000:2.0:1787782679.858693:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922342144 00000100:00100000:2.0:1787782679.858720:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787782679.858726:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6694:x1874625922342144:12345-0@lo:502: 00000100:00100000:2.0:1787782679.858872:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6694:x1874625922342144:12345-0@lo:502: Request processed in 146us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782679.858879:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787782679.858998:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922342144:0@lo:502: 00000040:00080000:1.0:1787782679.859135:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787782679.859146:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787782679.863496:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787782679.863516:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782679.863519:0:6717:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787782679.863529:0:6717:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c3129b5d800 00000020:00000080:0.0:1787782679.863531:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787782679.863588:0:6717:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787782679.863591:0:6717:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782679.863592:0:6717:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787782679.863595:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787782679.863869:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787782679.863898:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787782679.863924:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31029f5400/0x6d98ed19b636e7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e86 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.863937:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31029f5400/0x6d98ed19b636e7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e86 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782679.863992:0:6694:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787782679.863994:0:6694:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c3129b5d800 10000000:01000000:2.0:1787782679.863997:0:6694:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c3129b5d800 10000000:01000000:2.0:1787782679.864001:0:6694:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787782679.864005:0:6694:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c3129b5d800 from 1 10000000:01000000:2.0:1787782679.864007:0:6694:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787782679.864040:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.864046:0:6694:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.864055:0:6694:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782679.864076:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922342272:0@lo:101: 00000100:00100000:2.0:1787782679.864170:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782679.864231:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31346c56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782679.864750:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922342272 00000100:00100000:0.0:1787782679.864758:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922342272 00000100:00100000:0.0:1787782679.864841:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787782679.864852:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6694:x1874625922342272:12345-0@lo:101: 00010000:00010000:0.0:1787782679.864867:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782679.864952:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3100030600/0x6d98ed19b636e94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636e8d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782679.864982:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3100030600/0x6d98ed19b636e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636e8d expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782679.864995:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3100030600/0x6d98ed19b636e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636e8d expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782679.865004:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3100030600, rc 0) 00000100:00100000:0.0:1787782679.865064:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+13:6694:x1874625922342272:12345-0@lo:101: Request processed in 213us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782679.865071:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787782679.865413:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922342272:0@lo:101: 00010000:00010000:2.0:1787782679.865432:0:6694:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e94 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.865445:0:6694:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636e94 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782679.865557:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922342400:0@lo:501: 00000100:00100000:2.0:1787782679.865587:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782679.865621:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31346c56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782679.865650:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922342400 00000100:00100000:0.0:1787782679.865655:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922342400 00000100:00100000:0.0:1787782679.865723:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787782679.865731:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:6694:x1874625922342400:12345-0@lo:501: 00000100:00100000:0.0:1787782679.866039:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:6694:x1874625922342400:12345-0@lo:501: Request processed in 308us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782679.866046:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787782679.866435:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922342400:0@lo:501: 00000100:00100000:2.0:1787782679.866470:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922342528:0@lo:503: 00000100:00100000:2.0:1787782679.866509:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782679.866792:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31346c56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782679.866830:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922342528 00000100:00100000:3.0:1787782679.866836:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922342528 00000100:00100000:3.0:1787782679.866865:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787782679.866873:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:6694:x1874625922342528:12345-0@lo:503: 00000100:00100000:3.0:1787782679.867330:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:6694:x1874625922342528:12345-0@lo:503: Request processed in 457us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782679.867338:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787782679.867498:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922342528:0@lo:503: 00000040:00080000:2.0:1787782679.867871:0:6694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787782679.868286:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922342656:0@lo:502: 00000100:00100000:2.0:1787782679.868335:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782679.868419:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31346c56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782679.868511:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922342656 00000100:00100000:0.0:1787782679.868525:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922342656 00000100:00100000:0.0:1787782679.868678:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787782679.868687:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+13:6694:x1874625922342656:12345-0@lo:502: 00000100:00100000:0.0:1787782679.869047:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+13:6694:x1874625922342656:12345-0@lo:502: Request processed in 360us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782679.869055:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787782679.869240:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922342656:0@lo:502: 00000040:00080000:2.0:1787782679.869686:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787782679.869740:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787782679.869777:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787782679.869825:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787782679.869871:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787782679.870006:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787782679.870045:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787782679.870078:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787782679.870281:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787782679.870336:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787782679.870370:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787782679.870495:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787782679.870531:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787782679.870643:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787782679.870697:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787782679.870731:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787782679.870761:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787782679.870819:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787782679.870860:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787782679.870973:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787782679.871037:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787782679.871073:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787782679.871582:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787782679.871677:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787782679.871713:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787782679.871754:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787782679.871797:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787782679.871827:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787782679.872006:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922342784:0@lo:502: 00000100:00100000:2.0:1787782679.872092:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782679.872350:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31346c56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782679.872420:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922342784 00000100:00100000:3.0:1787782679.872427:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922342784 00000100:00100000:3.0:1787782679.872487:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787782679.872496:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:6694:x1874625922342784:12345-0@lo:502: 00000100:00100000:3.0:1787782679.872738:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:6694:x1874625922342784:12345-0@lo:502: Request processed in 243us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782679.872746:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787782679.873017:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922342784:0@lo:502: 00000040:00080000:2.0:1787782679.873123:0:6694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787782679.873136:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1787782679.874383:0:6718:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787782679.874485:0:6718:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8c31082999b8) 00000020:00000080:2.0:1787782679.874512:0:6718:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1787782679.874675:0:6718:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c3129b5d800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787782679.874679:0:6718:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c3129b5d800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787782679.874682:0:6718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c3129b5d800 3 00010000:00080000:2.0:1787782679.874729:0:6718:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c312e5e8000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.115@tcp at head 00010000:00010000:2.0:1787782679.877708:0:6718:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787782679.878052:0:6718:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787782679.878088:0:6718:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787782679.878132:0:6718:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6d98ed19b636ea2 00000100:00080000:2.0:1787782679.878153:0:6718:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787782679.878160:0:6718:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c312e5e8000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787782679.878210:0:6718:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3119e8b840 x1874625922342912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787782679.878287:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625922342912:0@lo:38: 00000100:00100000:3.0:1787782679.878369:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782679.878508:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922342912 00000100:00100000:1.0:1787782679.878517:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922342912 00000100:00100000:1.0:1787782679.878572:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787782679.878581:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874625922342912:12345-0@lo:38: 00010000:00080000:1.0:1787782679.878605:0:5853:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:1.0:1787782679.878649:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6d98ed19b636ea9 00000004:00100000:1.0:1787782679.878666:0:5853:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787782679.878700:0:5853:0:(import.c:65:import_set_state_nolock()) ffff8c313c93d000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787782679.878843:0:6718:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787782679.879125:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922343040:0@lo:400: 00000100:00100000:2.0:1787782679.879169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782679.879219:0:5851:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787782679.879228:0:5851:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787782679.881182:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922343040 00000100:00100000:2.0:1787782679.881192:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922343040 00000100:00100000:2.0:1787782679.881238:0:5851:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787782679.881249:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787782679.881258:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922343040:12345-0@lo:400: 00000100:00100000:2.0:1787782679.881331:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922343040:12345-0@lo:400: Request processed in 75us (2162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782679.881338:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787782679.881383:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c3119e89a40 x1874625922343040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782679.881936:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922343040:0@lo:400: 00000100:00100000:1.0:1787782679.882266:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625922342912:12345-0@lo:38: Request processed in 3684us (3896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782679.882275:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787782679.882694:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c3119e8b840 x1874625922342912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787782689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782679.882704:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787782679.882712:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787782679.882722:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787782679.882727:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787782679.882732:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c312e5e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787782679.882739:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625922342912:0@lo:38: 00000040:00080000:2.0:1787782679.886300:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1787782679.886589:0:6694:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787782679.886615:0:6694:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787782679.886640:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e94 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782679.886651:0:6694:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636e94 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787782679.886699:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787782679.886701:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787782679.886702:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787782679.886704:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787782679.886706:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787782679.886707:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787782679.886708:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787782679.886710:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787782679.886711:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787782679.886713:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787782679.886714:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787782679.886717:0:6694:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787782679.886720:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787782679.886722:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787782679.886723:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787782679.886725:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787782679.886726:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787782679.886727:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787782679.886728:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787782679.886729:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787782679.886730:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787782679.886731:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787782679.886733:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787782679.886762:0:6694:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787782679.886781:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922343168:0@lo:253: 00000100:00100000:1.0:1787782679.886854:0:6694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782679.887060:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312a2493c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782679.887276:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922343168 00000100:00100000:0.0:1787782679.887284:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922343168 00000100:00100000:0.0:1787782679.887345:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787782679.887356:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+13:6694:x1874625922343168:12345-0@lo:253: 20000000:01000000:0.0:1787782679.887387:0:5845:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787782679.887412:0:5845:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:3.0:1787782679.905347:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1787782679.926471:0:5845:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787782679.926529:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787782679.927332:0:5867:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787782679.927340:0:5867:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787782679.927362:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636eb0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.927381:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636e0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636e08 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.927401:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636eb0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.927443:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636e08 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.927458:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636e0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636e08 expref: 13 pid: 5846 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782679.927472:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e89a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1874625922343296:0@lo:104: 00000100:00100000:2.0:1787782679.927537:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782679.927707:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31346c53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782679.927768:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922343296 00000100:00100000:3.0:1787782679.927776:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922343296 00000100:00100000:3.0:1787782679.927827:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787782679.927836:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+3:5867:x1874625922343296:12345-0@lo:104: 00010000:00010000:3.0:1787782679.927848:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c3100030e00/0x6d98ed19b636e08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636e0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.927987:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787782679.927994:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+3:5867:x1874625922343296:12345-0@lo:104: Request processed in 160us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782679.928001:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787782679.928023:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782679.928029:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3100030e00/0x6d98ed19b636e08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636e0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.928036:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3100030e00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782679.928040:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3100030e00/0x6d98ed19b636e08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636e0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.928064:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3100030e00/0x6d98ed19b636e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636e0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782679.928072:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3100030e00/0x6d98ed19b636e08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636e0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782679.928078:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787782679.928125:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3100030e00/0x6d98ed19b636e08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636e0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.928132:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787782679.928242:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e89a40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1874625922343296:0@lo:104: 00010000:00010000:1.0:1787782679.928264:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636eb0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782679.928334:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922343424:0@lo:103: 00000100:00100000:1.0:1787782679.928367:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782679.928436:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922343424 00000100:00100000:2.0:1787782679.928441:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922343424 00010000:00010000:2.0:1787782679.928460:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636e0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636e08 expref: 14 pid: 5846 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782679.928481:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787782679.928487:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3118517c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+14:3307:x1874625922343424:12345-0@lo:103: 00010000:00010000:2.0:1787782679.928505:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782679.928511:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636e0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636e08 expref: 14 pid: 5846 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.928521:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636e0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636e08 expref: 14 pid: 5846 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.928534:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636e0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636e08 expref: 14 pid: 5846 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.928549:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636eb0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.928581:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636eb0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787782679.928596:0:5836:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003669618s 00010000:00010000:2.0:1787782679.928600:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636eb0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.928608:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636eb0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.928614:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636eb0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.928621:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636eb0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.928635:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0a00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787782679.928639:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636eb0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.928653:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636eb0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.928666:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636eb0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.928675:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787782679.928716:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3100030e00/0x6d98ed19b636e08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636e0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.928724:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3100030e00/0x6d98ed19b636e08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636e0f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782679.928738:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782679.928740:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782679.928742:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782679.932785:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3118517c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+13:3307:x1874625922343424:12345-0@lo:103: Request processed in 4286us (4405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782679.932800:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787782679.933020:0:5867:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636eb0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.933033:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636eb0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782679.933040:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636eb0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782679.933574:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922343424:0@lo:103: 00000100:00100000:2.0:1787782679.935416:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+12:6694:x1874625922343168:12345-0@lo:253: Request processed in 48056us (48556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782679.935429:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787782679.935545:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:6694:1874625922343168:0@lo:253: 10000000:01000000:1.0:1787782679.935610:0:6694:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787782679.935614:0:6694:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787782679.935616:0:6694:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787782679.935617:0:6694:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787782679.935619:0:6694:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787782679.935620:0:6694:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787782679.935621:0:6694:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787782679.935623:0:6694:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787782679.935633:0:6694:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787782679.935634:0:6694:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787782679.935636:0:6694:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787782679.935637:0:6694:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787782679.935653:0:6694:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787782679.942852:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782679.943369:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787782679.943743:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782679.943986:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787782679.944465:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782679.944784:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787782679.946455:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1787782680.170506:0:6694:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787782680.170517:0:6694:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787782680.170633:0:6694:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787782680.170702:0:6694:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787782680.170718:0:6694:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787782680.170752:0:6694:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787782680.929864:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782681.955770:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782682.977433:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782684.006114:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787782684.261619:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787782684.261628:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c311846c800 from 21 10000000:01000000:0.0:1787782684.261635:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787782684.261694:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636eb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782684.261706:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636eb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782684.262169:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636eb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782684.262196:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119ef5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922343552:0@lo:101: 00000100:00100000:0.0:1787782684.262256:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782684.262315:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102e7b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782684.262340:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922343552 00000100:00100000:0.0:1787782684.262346:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922343552 00000100:00100000:0.0:1787782684.262384:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787782684.262392:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5848:x1874625922343552:12345-0@lo:101: 00010000:00010000:0.0:1787782684.262404:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782684.262415:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3100030e00/0x6d98ed19b636ebe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636eb7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782684.262437:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3100030e00/0x6d98ed19b636ebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636eb7 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782684.262448:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3100030e00/0x6d98ed19b636ebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636eb7 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782684.262457:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3100030e00, rc 0) 00000100:00100000:0.0:1787782684.262486:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:5848:x1874625922343552:12345-0@lo:101: Request processed in 95us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782684.262493:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787782684.262540:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119ef5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922343552:0@lo:101: 00010000:00010000:0.0:1787782684.262554:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636eb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636ebe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782684.262563:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636eb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636ebe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782684.262623:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119ef5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922343680:0@lo:501: 00000100:00100000:0.0:1787782684.262646:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782684.262661:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102e7b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782684.262689:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922343680 00000100:00100000:0.0:1787782684.262693:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922343680 00000100:00100000:0.0:1787782684.262713:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787782684.262719:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+13:5848:x1874625922343680:12345-0@lo:501: 00000100:00100000:0.0:1787782684.264291:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+13:5848:x1874625922343680:12345-0@lo:501: Request processed in 1570us (1642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782684.264301:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787782684.264351:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119ef5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922343680:0@lo:501: 00000100:00100000:0.0:1787782684.264387:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119ef5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922343808:0@lo:503: 00000100:00100000:0.0:1787782684.264421:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782684.264436:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102e7b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782684.264448:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922343808 00000100:00100000:0.0:1787782684.264452:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922343808 00000100:00100000:0.0:1787782684.264474:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787782684.264480:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:5848:x1874625922343808:12345-0@lo:503: 00000100:00100000:0.0:1787782684.264748:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:5848:x1874625922343808:12345-0@lo:503: Request processed in 268us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782684.264755:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787782684.264792:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119ef5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922343808:0@lo:503: 00000100:00100000:0.0:1787782684.273615:0:6946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119ef5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:6946:1874625922343936:0@lo:502: 00000100:00100000:0.0:1787782684.273709:0:6946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782684.274309:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922343936 00000100:00100000:0.0:1787782684.274316:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922343936 00000100:00100000:0.0:1787782684.274368:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787782684.274377:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3107e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:6946:x1874625922343936:12345-0@lo:502: 00000100:00100000:0.0:1787782684.274648:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3107e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:6946:x1874625922343936:12345-0@lo:502: Request processed in 270us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782684.274662:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787782684.274717:0:6946:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102e7b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782684.275140:0:6946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119ef5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:6946:1874625922343936:0@lo:502: 00000100:00100000:0.0:1787782684.275199:0:6946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119ef5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:6946:1874625922344064:0@lo:502: 00000100:00100000:0.0:1787782684.275241:0:6946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782684.275263:0:6946:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102e7b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782684.275356:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922344064 00000100:00100000:1.0:1787782684.275362:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922344064 00000100:00100000:1.0:1787782684.275390:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787782684.275397:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3107e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:6946:x1874625922344064:12345-0@lo:502: 00000100:00100000:1.0:1787782684.275544:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3107e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:6946:x1874625922344064:12345-0@lo:502: Request processed in 148us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782684.275552:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787782684.275646:0:6946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119ef5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:6946:1874625922344064:0@lo:502: 00000040:00080000:0.0:1787782684.275666:0:6946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787782684.275875:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787782684.275892:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787782684.275902:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636eb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636ebe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782684.275912:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636eb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636ebe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782684.275922:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787782684.275924:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c311846c800 from 4 10000000:01000000:1.0:1787782684.275927:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787782684.275952:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b636ec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782684.275960:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b636ec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782684.275967:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b636ec5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782684.275978:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922344192:0@lo:101: 00000100:00100000:1.0:1787782684.276003:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782684.276031:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310716c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782684.276301:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922344192 00000100:00100000:3.0:1787782684.276305:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922344192 00000100:00100000:3.0:1787782684.276332:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787782684.276339:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+13:5848:x1874625922344192:12345-0@lo:101: 00010000:00010000:3.0:1787782684.276349:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782684.276362:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636ecc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636ec5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782684.276383:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636ecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636ec5 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782684.276394:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636ecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636ec5 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782684.276403:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31029f4c00, rc 0) 00000100:00100000:3.0:1787782684.276443:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+14:5848:x1874625922344192:12345-0@lo:101: Request processed in 104us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782684.276449:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787782684.276620:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd12c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922344192:0@lo:101: 00010000:00010000:2.0:1787782684.276635:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b636ec5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636ecc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782684.276644:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b636ec5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636ecc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782684.276710:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922344320:0@lo:256: 00000100:00100000:2.0:1787782684.276893:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782684.276914:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3109a370c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782684.277979:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922344320 00000100:00100000:0.0:1787782684.277986:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922344320 00000100:00100000:0.0:1787782684.278265:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787782684.278273:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+14:5848:x1874625922344320:12345-0@lo:256: 20000000:01000000:0.0:1787782684.278291:0:5844:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787782684.278303:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787782684.278306:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787782684.278378:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+14:5848:x1874625922344320:12345-0@lo:256: Request processed in 106us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782684.278383:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787782684.285187:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922344320:0@lo:256: 10000000:01000000:1.0:1787782684.285255:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787782684.285265:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b636ec5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636ecc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782684.285277:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b636ec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636ecc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782684.285296:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787782684.285299:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787782684.285302:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787782684.285336:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fd800/0x6d98ed19b636ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782684.285342:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31421fd800/0x6d98ed19b636ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782684.285350:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31421fd800/0x6d98ed19b636ed3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782684.285364:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922344448:0@lo:101: 00000100:00100000:1.0:1787782684.285416:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782684.285454:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922344448 00000100:00100000:1.0:1787782684.285457:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310716cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787782684.285461:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922344448 00000100:00100000:2.0:1787782684.285508:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787782684.285518:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:5848:x1874625922344448:12345-0@lo:101: 00010000:00010000:2.0:1787782684.285530:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782684.285542:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31013a1c00/0x6d98ed19b636eda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636ed3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782684.285566:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a1c00/0x6d98ed19b636eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636ed3 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782684.285578:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31013a1c00/0x6d98ed19b636eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636ed3 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782684.285599:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1c00, rc 0) 00000100:00100000:2.0:1787782684.285638:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922344448:12345-0@lo:101: Request processed in 122us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782684.286339:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787782684.286683:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922344448:0@lo:101: 00010000:00010000:1.0:1787782684.286700:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31421fd800/0x6d98ed19b636ed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636eda expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782684.286709:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31421fd800/0x6d98ed19b636ed3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636eda expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782684.286779:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922344576:0@lo:501: 00000100:00100000:1.0:1787782684.286808:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782684.286844:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310716cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787782684.286860:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922344576 00000100:00100000:1.0:1787782684.286864:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922344576 00000100:00100000:1.0:1787782684.286893:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787782684.286906:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922344576:12345-0@lo:501: 00000100:00100000:1.0:1787782684.287175:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922344576:12345-0@lo:501: Request processed in 269us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782684.287183:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787782684.287212:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922344576:0@lo:501: 00000100:00100000:1.0:1787782684.287236:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922344704:0@lo:503: 00000100:00100000:1.0:1787782684.287268:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782684.287286:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310716cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787782684.287296:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922344704 00000100:00100000:1.0:1787782684.287299:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922344704 00000100:00100000:1.0:1787782684.287314:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787782684.287319:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922344704:12345-0@lo:503: 00000100:00100000:1.0:1787782684.287582:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922344704:12345-0@lo:503: Request processed in 261us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782684.287601:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787782684.287638:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922344704:0@lo:503: 00000100:00100000:1.0:1787782684.289323:0:6952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:6952:1874625922344832:0@lo:502: 00000100:00100000:1.0:1787782684.289381:0:6952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782684.289447:0:6952:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31052b19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782684.289485:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922344832 00000100:00100000:0.0:1787782684.289491:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922344832 00000100:00100000:0.0:1787782684.289564:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787782684.289573:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+15:6952:x1874625922344832:12345-0@lo:502: 00000100:00100000:0.0:1787782684.289865:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+15:6952:x1874625922344832:12345-0@lo:502: Request processed in 292us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782684.289872:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787782684.290087:0:6952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:6952:1874625922344832:0@lo:502: 00000020:01000000:0.0:1787782684.290206:0:6952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787782684.290213:0:6952:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787782684.290220:0:6952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782684.290223:0:6952:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787782684.290228:0:6952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787782684.290231:0:6952:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.115@tcp to nid 0x20000c0a8ca73 (192.168.202.115@tcp) 00000020:01000000:0.0:1787782684.290254:0:6952:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787782684.290257:0:6952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787782684.290271:0:6952:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c311841b370) 00000020:00000080:0.0:1787782684.290289:0:6952:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787782684.290294:0:6952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787782684.290356:0:6952:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787782684.290362:0:6952:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787782684.290369:0:6952:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d98ed19b636ee8 00010000:00080000:0.0:1787782684.290395:0:6952:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c3001e12800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:0.0:1787782684.290751:0:6952:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787782684.358383:0:6952:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787782684.358407:0:6952:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787782684.358952:0:6952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782684.359151:0:6952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782684.359200:0:6952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787782684.359260:0:6952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787782684.360873:0:6958:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787782684.360879:0:6958:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787782684.368238:0:6952:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787782684.368253:0:6952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787782684.368290:0:6952:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787782684.368312:0:6952:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d98ed19b636eef 00000100:00080000:2.0:1787782684.368323:0:6952:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787782684.368336:0:6952:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c3001e12800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787782684.368371:0:6952:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3119e8b0c0 x1874625922344960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787782684.368392:0:6952:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787782684.368447:0:6952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782684.368452:0:6952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782684.368454:0:6952:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787782684.368457:0:6952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782684.368461:0:6952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782684.368462:0:6952:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787782684.368465:0:6952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787782684.368467:0:6952:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787782684.368494:0:6952:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:6952:1874625922345088:0@lo:502: 00000100:00100000:1.0:1787782684.368869:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625922345344:0@lo:400: 00000100:00100000:1.0:1787782684.368942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782684.368992:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787782684.368998:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922345216:0@lo:400: 00000100:00100000:1.0:1787782684.369024:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782684.369054:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922345472:0@lo:400: 00000100:00100000:1.0:1787782684.369092:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782684.369206:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922344960:0@lo:8: 00000100:00100000:0.0:1787782684.369239:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782684.369357:0:6952:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782684.369381:0:6952:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312a249a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787782684.369403:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922345344 00000100:00100000:2.0:1787782684.369409:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922345344 00000100:00100000:2.0:1787782684.369452:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922345472 00000100:00100000:2.0:1787782684.369454:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922345472 00000100:00100000:2.0:1787782684.369484:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787782684.369493:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625922345344:12345-0@lo:400: 00000100:00100000:1.0:1787782684.369609:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922345216 00000100:00100000:1.0:1787782684.369614:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922345216 00000100:00100000:1.0:1787782684.369639:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922345088 00000100:00100000:1.0:1787782684.369641:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922345088 00000100:00100000:1.0:1787782684.369654:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787782684.369660:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:3305:x1874625922345216:12345-0@lo:400: 00000100:00100000:1.0:1787782684.369698:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:3305:x1874625922345216:12345-0@lo:400: Request processed in 38us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782684.369705:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787782684.369730:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787782684.369736:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+15:6952:x1874625922345088:12345-0@lo:502: 00000100:00100000:1.0:1787782684.369949:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+15:6952:x1874625922345088:12345-0@lo:502: Request processed in 212us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782684.369956:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1787782684.369996:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782684.370022:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922345216:0@lo:400: 00000100:00100000:0.0:1787782684.370084:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787782684.370121:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922345472:12345-0@lo:400: 00000100:00100000:0.0:1787782684.370163:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922345472:12345-0@lo:400: Request processed in 71us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782684.370169:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787782684.370249:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625922345344:12345-0@lo:400: Request processed in 756us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782684.370255:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787782684.370283:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922344960 00000100:00100000:2.0:1787782684.370286:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922344960 00000100:00100000:2.0:1787782684.370304:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782684.370309:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1874625922344960:12345-0@lo:8: 00010000:00080000:2.0:1787782684.370328:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:2.0:1787782684.370360:0:6696:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d98ed19b636ef6 00002000:00100000:2.0:1787782684.370396:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c3001fd3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113937 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787782684.370401:0:6696:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1787782684.370405:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787782684.370507:0:6696:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:0.0:1787782684.370622:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119fd3480 x1874625922345344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782684.370634:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625922345344:0@lo:400: 00002000:00080000:2.0:1787782684.370796:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787782684.370831:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8c3001fd0800 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1787782684.370950:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119fd0000 x1874625922345472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782684.370960:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922345472:0@lo:400: 00000100:00100000:2.0:1787782684.371006:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874625922344960:12345-0@lo:8: Request processed in 695us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782684.371013:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782684.371047:0:6952:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:6952:1874625922345088:0@lo:502: 00000020:01000000:2.0:1787782684.371075:0:6952:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782684.371081:0:6952:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782684.371083:0:6952:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787782684.371087:0:6952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1787782684.371252:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1787782684.371275:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787782684.371283:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fd800/0x6d98ed19b636ed3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636eda expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782684.371293:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31421fd800/0x6d98ed19b636ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636eda expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782684.371303:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787782684.371305:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c31091e8000 from 1 10000000:01000000:1.0:1787782684.371308:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787782684.371331:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636efd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782684.371339:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636efd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782684.371348:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636efd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782684.371363:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922345600:0@lo:101: 00000100:00100000:1.0:1787782684.371392:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782684.371421:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311863d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787782684.371458:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922345600 00000100:00100000:2.0:1787782684.371462:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922345600 00000100:00100000:2.0:1787782684.372378:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787782684.372388:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922345600:12345-0@lo:101: 00010000:00010000:2.0:1787782684.372398:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782684.372410:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31013a1600/0x6d98ed19b636f04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636efd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782684.372432:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a1600/0x6d98ed19b636f04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636efd expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782684.372443:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31013a1600/0x6d98ed19b636f04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636efd expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782684.372461:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1600, rc 0) 00000100:00100000:2.0:1787782684.372506:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922345600:12345-0@lo:101: Request processed in 120us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782684.372512:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787782684.372636:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922345600:0@lo:101: 00010000:00010000:3.0:1787782684.372650:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636efd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f04 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782684.372659:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636efd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636f04 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782684.372722:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187a8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922345728:0@lo:501: 00000100:00100000:3.0:1787782684.372753:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787782684.375831:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119e8b0c0 x1874625922344960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787782694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782684.375862:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787782684.375872:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787782684.375881:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787782684.375887:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787782684.375891:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c3001e12800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787782684.375908:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787782684.375914:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922344960:0@lo:8: 00000100:00100000:3.0:1787782684.378698:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3109a37540 going to sleep for 11 seconds 00000100:00100000:1.0:1787782684.378824:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922345728 00000100:00100000:1.0:1787782684.378834:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922345728 00000100:00100000:1.0:1787782684.378879:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787782684.378888:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922345728:12345-0@lo:501: 00000100:00100000:1.0:1787782684.379178:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922345728:12345-0@lo:501: Request processed in 290us (6423us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787782684.379186:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787782684.382163:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187a8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922345728:0@lo:501: 10000000:01000000:3.0:1787782684.382222:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787782684.382237:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636efd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f04 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782684.382248:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636efd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f04 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787782684.382912:0:6958:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787782684.383380:0:6958:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 169053283542ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787782684.421239:0:6959:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787782684.421246:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922345856:0@lo:13: 00000100:00100000:3.0:1787782684.421263:0:6959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187a83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6959:1874625922345984:0@lo:7: 00000100:00100000:1.0:1787782684.423260:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782684.423373:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922345856 00000100:00100000:1.0:1787782684.423383:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922345856 00000100:00100000:1.0:1787782684.423430:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782684.423439:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922345856:12345-0@lo:13: 00002000:00000024:1.0:1787782684.423473:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1787782684.423520:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922345856:12345-0@lo:13: Request processed in 83us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782684.423528:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787782684.423548:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787782684.423577:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c31187a8f00 x1874625922345856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782684.423607:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922345856:0@lo:13: 00000100:00100000:3.0:1787782684.424980:0:6959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782684.425015:0:6959:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3109a37540 going to sleep for 11 seconds 00000100:00100000:0.0:1787782684.425142:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922345984 00000100:00100000:0.0:1787782684.425148:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922345984 00000100:00100000:0.0:1787782684.425183:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787782684.425192:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6959:x1874625922345984:12345-0@lo:7: 00002000:00080000:0.0:1787782684.433385:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787782684.433394:0:6698:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787782684.433499:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6959:x1874625922345984:12345-0@lo:7: Request processed in 8303us (8516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782684.433510:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787782684.433999:0:6959:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c31187a83c0 x1874625922345984/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787782700 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782684.434016:0:6959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187a83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6959:1874625922345984:0@lo:7: 00000004:00080000:2.0:1787782684.434029:0:6959:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787782684.434066:0:6959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6959:1874625922346112:0@lo:5: 00000100:00100000:2.0:1787782684.434131:0:6959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782684.434165:0:6959:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310701bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787782684.434186:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922346112 00000100:00100000:2.0:1787782684.434192:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922346112 00000100:00100000:2.0:1787782684.434228:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782684.434234:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787782684.434238:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6959:x1874625922346112:12345-0@lo:5: 00000100:00100000:0.0:1787782684.434241:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:2.0:1787782684.434263:0:6697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787782684.434267:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787782684.434469:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6959:x1874625922346112:12345-0@lo:5: Request processed in 233us (338us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787782684.434476:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787782684.434497:0:6959:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119e88f00 x1874625922346112/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787782700 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782684.434509:0:6959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6959:1874625922346112:0@lo:5: 00000004:00080000:0.0:1787782684.434517:0:6959:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787782684.434541:0:6959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119ef61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6959:1874625922346240:0@lo:700: 00000100:00100000:0.0:1787782684.434565:0:6959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782684.434581:0:6959:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129f08d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782684.434611:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922346240 00000100:00100000:0.0:1787782684.434620:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922346240 00000100:00100000:0.0:1787782684.434641:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787782684.434866:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6959:x1874625922346240:12345-0@lo:700: 00000100:00100000:0.0:1787782684.434893:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119ef4780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6705:1874625922346368:0@lo:700: 00000100:00100000:0.0:1787782684.435233:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782684.435251:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129f080c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782684.435271:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922346368 00000100:00100000:0.0:1787782684.435275:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922346368 00000100:00100000:0.0:1787782684.435424:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787782684.435431:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0000_UUID+5:6705:x1874625922346368:12345-0@lo:700: 00000004:00080000:1.0:1787782684.446293:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1787782684.486223:0:5859:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1787782684.498306:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0000_UUID+5:6705:x1874625922346368:12345-0@lo:700: Request processed in 62866us (63064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782684.498320:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787782684.498387:0:6705:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119ef4780 x1874625922346368/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787782700 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782684.498403:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119ef4780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6705:1874625922346368:0@lo:700: 40000000:02000000:1.0:1787782684.498417:0:6705:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1787782684.628471:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787782684.628487:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787782684.628593:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6959:x1874625922346240:12345-0@lo:700: Request processed in 193716us (194011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782684.628609:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787782684.628867:0:6959:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119ef61c0 x1874625922346240/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787782700 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782684.628879:0:6959:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787782684.628901:0:6959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119ef61c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6959:1874625922346240:0@lo:700: 00000004:02000040:0.0:1787782684.667775:0:6959:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787782684.673639:0:6959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119ef6580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6959:1874625922346496:0@lo:5: 00000100:00100000:0.0:1787782684.673890:0:6959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782684.674039:0:6959:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129f08300 going to sleep for 11 seconds 00000100:00100000:1.0:1787782684.674377:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922346496 00000100:00100000:1.0:1787782684.674385:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922346496 00000100:00100000:1.0:1787782684.674448:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787782684.674457:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6959:x1874625922346496:12345-0@lo:5: 00002000:00080000:0.0:1787782684.682363:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787782684.682381:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787782684.687651:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6959:x1874625922346496:12345-0@lo:5: Request processed in 13175us (13741us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787782684.687902:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787782684.688890:0:6959:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119ef6580 x1874625922346496/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787782700 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782684.688910:0:6959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119ef6580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6959:1874625922346496:0@lo:5: 00000004:00080000:2.0:1787782684.688925:0:6959:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787782685.028945:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782686.049226:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787782686.445268:0:7067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787782687.079045:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782688.097853:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782689.121244:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782689.377446:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625922346752:0@lo:400: 00000100:00100000:1.0:1787782689.377505:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922346880:0@lo:400: 00000100:00100000:1.0:1787782689.377570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782689.377638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782689.377663:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782689.377672:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922347008:0@lo:400: 00000100:00100000:0.0:1787782689.377686:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787782689.377695:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922346624:0@lo:400: 00000100:00100000:3.0:1787782689.377936:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922346880 00000100:00100000:3.0:1787782689.377944:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922346880 00000100:00100000:3.0:1787782689.378020:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922346752 00000100:00100000:3.0:1787782689.378023:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922346752 00000100:00100000:3.0:1787782689.378046:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787782689.378055:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922346880:12345-0@lo:400: 00000100:00080000:2.0:1787782689.378916:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782689.378946:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787782689.378956:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625922346752:12345-0@lo:400: 00000100:00100000:1.0:1787782689.384121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782689.384121:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782689.384220:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922346624 00000100:00100000:1.0:1787782689.384228:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922346624 00000100:00100000:0.0:1787782689.384249:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922347008 00000100:00100000:0.0:1787782689.384254:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922347008 00000100:00100000:1.0:1787782689.384297:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787782689.384308:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31091ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+16:3305:x1874625922346624:12345-0@lo:400: 00000100:00100000:1.0:1787782689.384381:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31091ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+16:3305:x1874625922346624:12345-0@lo:400: Request processed in 75us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782689.384388:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787782689.384407:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787782689.384419:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874625922347008:12345-0@lo:400: 00000100:00100000:1.0:1787782689.385208:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922346624:0@lo:400: 00000100:00080000:1.0:1787782689.385248:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787782689.385424:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922346880:12345-0@lo:400: Request processed in 7369us (7852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782689.385463:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787782689.385724:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c31187ab840 x1874625922346880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782689.385748:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922346880:0@lo:400: 00000100:00100000:2.0:1787782689.385953:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625922346752:12345-0@lo:400: Request processed in 6998us (8316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782689.385961:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787782689.386038:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874625922347008:12345-0@lo:400: Request processed in 1620us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782689.386047:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787782689.386138:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c31187a8000 x1874625922346752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782689.386150:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625922346752:0@lo:400: 00010000:00080000:3.0:1787782689.390664:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c31187abc00 x1874625922347008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782689.390685:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922347008:0@lo:400: 00000100:00100000:2.0:1787782689.890376:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922347136:0@lo:13: 00000100:00100000:2.0:1787782689.890456:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782689.891587:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922347136 00000100:00100000:1.0:1787782689.891600:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922347136 00000100:00100000:1.0:1787782689.891658:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787782689.891668:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625922347136:12345-0@lo:13: 00002000:00000024:1.0:1787782689.891710:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782689.891789:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625922347136:12345-0@lo:13: Request processed in 121us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782689.891807:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787782689.892161:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119e89a40 x1874625922347136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782689.892181:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922347136:0@lo:13: 00000001:00080000:0.0:1787782689.956516:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787782690.148248:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782691.174726:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782692.196137:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782693.219176:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782694.242238:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782694.510174:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922347264:0@lo:400: 00000100:00100000:2.0:1787782694.510259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782694.510314:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787782694.510321:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922347648:0@lo:400: 00000100:00100000:2.0:1787782694.510350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782694.510896:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922347392:0@lo:400: 00000100:00100000:3.0:1787782694.510931:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782694.510963:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787782694.510970:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922347520:0@lo:400: 00000100:00100000:3.0:1787782694.510993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782694.511029:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922347648 00000100:00100000:3.0:1787782694.511037:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922347648 00000100:00100000:3.0:1787782694.511091:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787782694.511120:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922347648:12345-0@lo:400: 00000100:00100000:3.0:1787782694.511171:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922347648:12345-0@lo:400: Request processed in 52us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782694.511179:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787782694.511216:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922347392 00000100:00100000:3.0:1787782694.511219:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922347392 00000100:00100000:3.0:1787782694.511240:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922347520 00000100:00100000:3.0:1787782694.511242:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922347520 00000100:00100000:3.0:1787782694.511261:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787782694.511267:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922347392:12345-0@lo:400: 00000100:00100000:3.0:1787782694.511330:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922347392:12345-0@lo:400: Request processed in 62us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782694.511336:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787782694.511348:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787782694.511353:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922347520:12345-0@lo:400: 00000100:00100000:3.0:1787782694.511378:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922347520:12345-0@lo:400: Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782694.511384:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787782694.511399:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787782694.511403:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787782694.511433:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119e88b40 x1874625922347520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782694.511447:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922347520:0@lo:400: 00010000:00080000:3.0:1787782694.511457:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119e88000 x1874625922347392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782694.511465:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922347392:0@lo:400: 00010000:00080000:3.0:1787782694.511504:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119e88780 x1874625922347648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782694.511512:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787782694.511523:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922347648:0@lo:400: 00000100:00100000:0.0:1787782694.512687:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922347264 00000100:00100000:0.0:1787782694.512695:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922347264 00000100:00100000:0.0:1787782694.512736:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787782694.512746:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31091b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+16:3305:x1874625922347264:12345-0@lo:400: 00000100:00100000:0.0:1787782694.512818:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31091b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+16:3305:x1874625922347264:12345-0@lo:400: Request processed in 75us (2560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782694.512825:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787782694.521669:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922347264:0@lo:400: 00000100:00100000:0.0:1787782695.009899:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922347776:0@lo:13: 00000100:00100000:0.0:1787782695.009958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782695.010046:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922347776 00000100:00100000:1.0:1787782695.010053:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922347776 00000100:00100000:1.0:1787782695.010234:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787782695.010246:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922347776:12345-0@lo:13: 00002000:00000024:1.0:1787782695.010284:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782695.010351:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922347776:12345-0@lo:13: Request processed in 108us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782695.010360:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787782695.010728:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119e883c0 x1874625922347776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782695.012810:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922347776:0@lo:13: 00010000:00010000:3.0:1787782695.266261:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782696.291141:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782697.318160:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782698.337986:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787782698.367681:0:7631:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787782698.367685:0:7631:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787782698.367790:0:7631:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c310712b000 00000020:01000004:1.0:1787782698.367806:0:7631:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787782698.367819:0:7631:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787782698.367901:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8c31068d3370) 00000020:00000080:1.0:1787782698.367919:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787782698.389718:0:7631:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787782698.390194:0:7631:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787782698.434197:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787782698.446188:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787782698.446232:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787782698.446299:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787782698.446329:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787782698.447340:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787782698.447353:0:7631:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787782698.447367:0:7631:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6d98ed19b636f12 00000020:01000004:3.0:1787782698.447375:0:7631:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787782698.447408:0:7631:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.115@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787782698.447412:0:7631:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787782698.447423:0:7631:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787782698.447446:0:7631:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787782698.447450:0:7631:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787782698.475735:0:7631:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787782698.475849:0:7631:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.115@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787782698.475854:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787782698.475856:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787782698.475857:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782698.475863:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782698.475864:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782698.475866:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782698.475867:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782698.475868:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787782698.475870:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787782698.475871:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782698.475873:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787782698.475876:0:7631:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787782698.475878:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787782698.475879:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787782698.475880:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782698.475881:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782698.475882:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782698.475883:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782698.475884:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782698.475885:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787782698.475886:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787782698.475887:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782698.475888:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787782698.475914:0:7631:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787782698.475933:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922347904:0@lo:253: 00000100:00100000:2.0:1787782698.476012:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782698.476071:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31063a49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782698.476187:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922347904 00000100:00100000:1.0:1787782698.476194:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922347904 00000100:00100000:1.0:1787782698.476243:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787782698.476252:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31091b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:7631:x1874625922347904:12345-0@lo:253: 20000000:01000000:1.0:1787782698.476288:0:5845:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787782698.476292:0:5845:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787782698.476297:0:5845:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787782698.476300:0:5845:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787782698.478445:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782698.478939:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787782698.478951:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787782698.478977:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787782698.478982:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787782698.478997:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787782698.479023:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787782698.481017:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787782698.481043:0:5845:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.115@tcp 20000000:01000000:1.0:1787782698.481045:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.115@tcp (null) (null) (null) 00000040:00080000:1.0:1787782698.481081:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787782698.481088:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787782698.481169:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787782698.481178:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.115@tcp (null) (null) 00000040:00080000:1.0:1787782698.481205:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787782698.481213:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787782698.481241:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787782698.481284:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787782698.489253:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787782698.489291:0:5845:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.115@tcp 20000000:01000000:1.0:1787782698.489295:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.115@tcp (null) (null) (null) 00000040:00080000:1.0:1787782698.489549:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787782698.489559:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787782698.489594:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787782698.489602:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.115@tcp (null) (null) 00000040:00080000:1.0:1787782698.489645:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787782698.489656:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787782698.491072:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787782698.491139:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787782698.491164:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787782698.491168:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787782698.491171:0:5845:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787782698.491183:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787782698.491186:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787782698.491228:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787782698.491231:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787782698.495952:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787782698.496057:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787782698.496133:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787782698.498246:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787782698.498299:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787782698.498386:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1787782698.498415:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787782698.498418:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787782698.499356:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787782698.499642:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787782698.499703:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787782698.500026:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787782698.500062:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787782698.500117:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1787782698.500130:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787782698.500132:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787782698.512994:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787782698.513085:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1787782698.513168:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787782698.514060:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787782698.514311:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787782698.514383:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787782698.514470:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787782698.514474:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787782698.515513:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787782698.516057:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787782698.516317:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787782698.523225:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787782698.523269:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787782698.523272:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787782698.523281:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787782698.523303:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c31013a0200/0x6d98ed19b636f19 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.523336:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3100030200/0x6d98ed19b636e6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636e63 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.523344:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3100030600/0x6d98ed19b636e94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636e8d expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.523351:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3100030e00/0x6d98ed19b636ebe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636eb7 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.523357:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31013a1c00/0x6d98ed19b636eda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636ed3 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.523364:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31013a1600/0x6d98ed19b636f04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636efd expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.523371:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c31013a0200/0x6d98ed19b636f19 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.523411:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31013a1600/0x6d98ed19b636f04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636efd expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.523426:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c31013a1600/0x6d98ed19b636f04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636efd expref: 16 pid: 5845 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782698.523440:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5845:1874625922348032:0@lo:104: 00000100:00100000:2.0:1787782698.523519:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787782698.523579:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31013a1c00/0x6d98ed19b636eda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636ed3 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.523587:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c31013a1c00/0x6d98ed19b636eda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636ed3 expref: 16 pid: 5846 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782698.523602:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5845:1874625922348160:0@lo:104: 00000100:00100000:1.0:1787782698.523940:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787782698.523960:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782698.523982:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922348032 00000100:00100000:1.0:1787782698.523988:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922348032 00000100:00100000:1.0:1787782698.524019:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922348160 00000100:00100000:1.0:1787782698.524021:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922348160 00000100:00100000:1.0:1787782698.524032:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787782698.524039:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109054850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+4:5845:x1874625922348032:12345-0@lo:104: 00010000:00010000:1.0:1787782698.524051:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636efd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636f04 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.524117:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787782698.524123:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109054850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+4:5845:x1874625922348032:12345-0@lo:104: Request processed in 85us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782698.524131:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787782698.524171:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787782698.524177:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+3:5845:x1874625922348160:12345-0@lo:104: 00010000:00010000:1.0:1787782698.524185:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31421fd800/0x6d98ed19b636ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636eda expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.524216:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787782698.524221:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+3:5845:x1874625922348160:12345-0@lo:104: Request processed in 45us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782698.524227:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1787782698.524246:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787782698.524251:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636efd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636f04 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.524259:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fce00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:1.0:1787782698.524262:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636efd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636f04 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.524270:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636efd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636f04 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782698.524277:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636efd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636f04 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782698.524282:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787782698.524317:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636efd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f04 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.524324:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787782698.524340:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636efd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f04 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.524347:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636efd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f04 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.524359:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782698.524363:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31421fd800/0x6d98ed19b636ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636eda expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.524368:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fd800 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:1.0:1787782698.524371:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31421fd800/0x6d98ed19b636ed3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636eda expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.524378:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31421fd800/0x6d98ed19b636ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636eda expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782698.524384:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31421fd800/0x6d98ed19b636ed3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636eda expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782698.524401:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787782698.524414:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31421fd800/0x6d98ed19b636ed3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636eda expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.524420:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787782698.524426:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31421fd800/0x6d98ed19b636ed3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636eda expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.524442:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31421fd800/0x6d98ed19b636ed3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636eda expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.524451:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782698.524453:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782698.524454:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782698.524471:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782698.524490:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922348288:0@lo:103: 00000100:00100000:1.0:1787782698.524517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782698.524540:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782698.524546:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922348416:0@lo:103: 00000100:00100000:1.0:1787782698.524568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782698.524598:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922348288 00000100:00100000:1.0:1787782698.524602:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922348288 00010000:00010000:1.0:1787782698.524616:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31013a1600/0x6d98ed19b636f04 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636efd expref: 17 pid: 5845 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782698.524633:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922348416 00000100:00100000:1.0:1787782698.524647:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922348416 00010000:00010000:1.0:1787782698.524662:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31013a1c00/0x6d98ed19b636eda lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636ed3 expref: 18 pid: 5846 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782698.525984:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787782698.526003:0:5836:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787782698.526008:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+18:3306:x1874625922348288:12345-0@lo:103: 00000100:00100000:0.0:1787782698.526011:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787782698.526022:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782698.526029:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31013a1600/0x6d98ed19b636f04 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636efd expref: 18 pid: 5845 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.526053:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31013a1600/0x6d98ed19b636f04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636efd expref: 18 pid: 5845 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.526070:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782698.526123:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+18:3306:x1874625922348288:12345-0@lo:103: Request processed in 130us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782698.526130:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787782698.526145:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787782698.526151:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+17:3306:x1874625922348416:12345-0@lo:103: 00010000:00010000:1.0:1787782698.526158:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782698.526162:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31013a1c00/0x6d98ed19b636eda lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636ed3 expref: 17 pid: 5846 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.526171:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31013a1c00/0x6d98ed19b636eda lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636ed3 expref: 17 pid: 5846 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.526181:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782698.526202:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+17:3306:x1874625922348416:12345-0@lo:103: Request processed in 52us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782698.526208:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787782698.526252:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922348416:0@lo:103: 00000100:00100000:1.0:1787782698.526262:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922348288:0@lo:103: 00010000:00010000:2.0:1787782698.526336:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3100030e00/0x6d98ed19b636ebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636eb7 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.526347:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c3100030e00/0x6d98ed19b636ebe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636eb7 expref: 16 pid: 5846 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782698.526358:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8a580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5845:1874625922348544:0@lo:104: 00000100:00100000:2.0:1787782698.526386:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787782698.526429:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3100030600/0x6d98ed19b636e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636e8d expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.526438:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c3100030600/0x6d98ed19b636e94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636e8d expref: 16 pid: 5845 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782698.526446:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5845:1874625922348672:0@lo:104: 00000100:00100000:2.0:1787782698.526478:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787782698.526509:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3100030200/0x6d98ed19b636e6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636e63 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.526517:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c3100030200/0x6d98ed19b636e6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636e63 expref: 16 pid: 5844 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782698.526524:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5845:1874625922348800:0@lo:104: 00000100:00100000:2.0:1787782698.526545:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782698.526553:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31063a40c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787782698.526563:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31013a1600/0x6d98ed19b636f04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636efd expref: 16 pid: 5845 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782698.526585:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5845:1874625922348032:0@lo:104: 00010000:00010000:2.0:1787782698.526596:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31013a1c00/0x6d98ed19b636eda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636ed3 expref: 15 pid: 5846 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782698.526603:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5845:1874625922348160:0@lo:104: 00000100:00100000:0.0:1787782698.526941:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922348544 00000100:00100000:0.0:1787782698.526946:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922348544 00000100:00100000:0.0:1787782698.526975:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922348672 00000100:00100000:0.0:1787782698.526979:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922348672 00000100:00100000:0.0:1787782698.526989:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922348800 00000100:00100000:0.0:1787782698.526991:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922348800 00000100:00100000:1.0:1787782698.526994:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787782698.527002:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e88780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+5:5845:x1874625922348544:12345-0@lo:104: 00010000:00010000:1.0:1787782698.527012:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636eb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636ebe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.527072:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787782698.527078:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e88780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+5:5845:x1874625922348544:12345-0@lo:104: Request processed in 78us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782698.527084:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787782698.527156:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787782698.527163:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e88b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+4:5845:x1874625922348672:12345-0@lo:104: 00010000:00010000:3.0:1787782698.527168:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782698.527170:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636e94 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.527174:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636eb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636ebe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.527181:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3100031200 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782698.527185:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636eb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636ebe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.527193:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636eb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636ebe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.527200:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787782698.527204:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e88b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+4:5845:x1874625922348672:12345-0@lo:104: Request processed in 43us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782698.527210:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 10000000:00010000:3.0:1787782698.527211:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636eb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636ebe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782698.527270:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787782698.527297:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636eb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636ebe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.527304:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782698.527318:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636eb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636ebe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.527444:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636eb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636ebe expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.527455:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782698.527467:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636e94 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.527473:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1e00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782698.527476:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636e94 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782698.527481:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8a580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5845:1874625922348544:0@lo:104: 00010000:00010000:3.0:1787782698.527482:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636e94 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782698.527488:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5845:1874625922348672:0@lo:104: 10000000:00010000:3.0:1787782698.527489:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636e94 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782698.527495:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787782698.527515:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636e94 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.527521:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787782698.527526:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787782698.527527:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636e94 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.527533:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636e8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636e94 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782698.527533:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+3:5845:x1874625922348800:12345-0@lo:104: 00010000:00010000:1.0:1787782698.527540:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31029f5600/0x6d98ed19b636e63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636e6a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.527542:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782698.527544:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782698.527546:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782698.527588:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1787782698.527589:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787782698.527594:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+3:5845:x1874625922348800:12345-0@lo:104: Request processed in 61us (1048us total) trans 0 rc 0/0 00010000:00010000:0.0:1787782698.527594:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31029f5600/0x6d98ed19b636e63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636e6a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782698.527600:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787782698.527601:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f5600 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:0.0:1787782698.527604:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31029f5600/0x6d98ed19b636e63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636e6a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.527611:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31029f5600/0x6d98ed19b636e63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636e6a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782698.527617:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31029f5600/0x6d98ed19b636e63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636e6a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782698.527622:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787782698.527641:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31029f5600/0x6d98ed19b636e63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636e6a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.527647:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782698.527749:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782698.528012:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1787782698.528033:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31029f5600/0x6d98ed19b636e63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636e6a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782698.528052:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5845:1874625922348800:0@lo:104: 00010000:00010000:0.0:1787782698.528052:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31029f5600/0x6d98ed19b636e63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636e6a expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.528066:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782698.528067:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782698.528069:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782698.528083:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c31013a0200/0x6d98ed19b636f19 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782698.528150:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922348928:0@lo:103: 00000100:00100000:0.0:1787782698.528187:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782698.528238:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787782698.528253:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922349056:0@lo:103: 00000100:00100000:0.0:1787782698.528289:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782698.528318:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922348928 00000100:00100000:1.0:1787782698.528322:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922348928 00010000:00010000:1.0:1787782698.528341:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3100030e00/0x6d98ed19b636ebe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636eb7 expref: 15 pid: 5846 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782698.528426:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922349056 00000100:00100000:1.0:1787782698.528430:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922349056 00010000:00010000:1.0:1787782698.528444:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3100030600/0x6d98ed19b636e94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636e8d expref: 16 pid: 5845 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782698.528528:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119ef5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922349184:0@lo:103: 00000100:00100000:3.0:1787782698.528555:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782698.529682:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922349184 00000100:00100000:0.0:1787782698.529689:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922349184 00010000:00010000:0.0:1787782698.529715:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3100030200/0x6d98ed19b636e6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636e63 expref: 17 pid: 5844 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782698.529735:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787782698.529745:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:3304:x1874625922348928:12345-0@lo:103: 00010000:00010000:0.0:1787782698.529757:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782698.529762:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3100030e00/0x6d98ed19b636ebe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636eb7 expref: 17 pid: 5846 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.529773:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3100030e00/0x6d98ed19b636ebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636eb7 expref: 17 pid: 5846 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.529788:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3100030e00/0x6d98ed19b636ebe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636eb7 expref: 17 pid: 5846 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.529805:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782698.530003:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:3304:x1874625922348928:12345-0@lo:103: Request processed in 259us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782698.530010:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787782698.530026:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787782698.530032:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+15:3304:x1874625922349056:12345-0@lo:103: 00000100:00100000:3.0:1787782698.530034:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922348928:0@lo:103: 00010000:00010000:0.0:1787782698.530040:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782698.530055:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3100030600/0x6d98ed19b636e94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636e8d expref: 15 pid: 5845 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.530064:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3100030600/0x6d98ed19b636e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636e8d expref: 15 pid: 5845 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.530075:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3100030600/0x6d98ed19b636e94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636e8d expref: 15 pid: 5845 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.530083:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782698.530127:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+14:3304:x1874625922349056:12345-0@lo:103: Request processed in 95us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782698.530133:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787782698.530134:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922349056:0@lo:103: 00000100:00100000:0.0:1787782698.530145:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787782698.530150:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+13:3307:x1874625922349184:12345-0@lo:103: 00010000:00010000:0.0:1787782698.530158:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782698.530163:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3100030200/0x6d98ed19b636e6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636e63 expref: 13 pid: 5844 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.530172:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3100030200/0x6d98ed19b636e6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636e63 expref: 13 pid: 5844 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.530182:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3100030200/0x6d98ed19b636e6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636e63 expref: 13 pid: 5844 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.530192:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c31013a0200/0x6d98ed19b636f19 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.530199:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a0200/0x6d98ed19b636f19 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.530228:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c31013a0200/0x6d98ed19b636f19 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.530235:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c31013a0200/0x6d98ed19b636f19 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.530242:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c31013a0200/0x6d98ed19b636f19 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.530252:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c31013a0200/0x6d98ed19b636f19 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.530258:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0200 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782698.530262:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c31013a0200/0x6d98ed19b636f19 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.530268:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c31013a0200/0x6d98ed19b636f19 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.530282:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c31013a0200/0x6d98ed19b636f19 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.530292:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787782698.530301:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c31013a0200/0x6d98ed19b636f19 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.530309:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c31013a0200/0x6d98ed19b636f19 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.530316:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31013a0200/0x6d98ed19b636f19 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782698.530320:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+12:3307:x1874625922349184:12345-0@lo:103: Request processed in 169us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782698.530325:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787782698.530351:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119ef5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922349184:0@lo:103: 20000000:01000000:3.0:1787782698.530450:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787782698.583989:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31091b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+11:7631:x1874625922347904:12345-0@lo:253: Request processed in 107729us (107969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782698.584022:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787782698.584133:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922347904:0@lo:253: 10000000:01000000:2.0:1787782698.584148:0:7631:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787782698.584152:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787782698.584154:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787782698.584155:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782698.584156:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787782698.584158:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782698.584159:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782698.584160:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782698.584162:0:7631:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787782698.584163:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782698.584165:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787782698.584185:0:7631:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c310712b000 from lustre-OST0001 10000000:01000000:2.0:1787782698.584208:0:7631:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787782698.584211:0:7631:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787782698.584343:0:7631:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c31091e8000 local copy 10000000:01000000:2.0:1787782698.584348:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787782698.584382:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636f20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.584409:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636f20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.584420:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636f20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782698.584437:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922349312:0@lo:101: 00000100:00100000:2.0:1787782698.584483:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782698.584525:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31063a4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787782698.584636:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922349312 00000100:00100000:1.0:1787782698.584643:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922349312 00000100:00100000:1.0:1787782698.584748:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787782698.584758:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31091b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+11:7631:x1874625922349312:12345-0@lo:101: 00010000:00010000:1.0:1787782698.584774:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782698.584789:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31421fd800/0x6d98ed19b636f27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636f20 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.584812:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31421fd800/0x6d98ed19b636f27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636f20 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.584878:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31421fd800/0x6d98ed19b636f27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636f20 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.584889:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31421fd800, rc 0) 00000100:00100000:1.0:1787782698.584931:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31091b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:7631:x1874625922349312:12345-0@lo:101: Request processed in 174us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782698.584937:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787782698.585356:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922349312:0@lo:101: 00010000:00010000:2.0:1787782698.585370:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636f20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x6d98ed19b636f27 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.585379:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636f20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6d98ed19b636f27 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782698.585491:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922349440:0@lo:501: 00000100:00100000:2.0:1787782698.585516:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782698.585542:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31063a4900 going to sleep for 11 seconds 00000100:00100000:0.0:1787782698.585639:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922349440 00000100:00100000:0.0:1787782698.585643:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922349440 00000100:00100000:0.0:1787782698.585673:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787782698.585737:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+12:7631:x1874625922349440:12345-0@lo:501: 00000100:00100000:0.0:1787782698.586004:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+12:7631:x1874625922349440:12345-0@lo:501: Request processed in 270us (486us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787782698.586012:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787782698.586127:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922349440:0@lo:501: 10000000:01000000:2.0:1787782698.586140:0:7631:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787782698.586166:0:7631:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787782698.586171:0:7631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636f20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x6d98ed19b636f27 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.586179:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636f20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6d98ed19b636f27 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.586195:0:7631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636f20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x6d98ed19b636f27 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.586335:0:7631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787782698.586357:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c310712b000 10000000:01000000:2.0:1787782698.586361:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787782698.586367:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787782698.586369:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787782698.586373:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787782698.586376:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787782698.586402:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1600/0x6d98ed19b636f2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.586411:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31013a1600/0x6d98ed19b636f2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.586419:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31013a1600/0x6d98ed19b636f2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782698.586433:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922349568:0@lo:101: 00000100:00100000:2.0:1787782698.586470:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782698.586497:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31063a4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782698.587191:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922349568 00000100:00100000:0.0:1787782698.587197:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922349568 00000100:00100000:0.0:1787782698.587711:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787782698.587721:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+12:7631:x1874625922349568:12345-0@lo:101: 00010000:00010000:0.0:1787782698.587731:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782698.587746:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3100030200/0x6d98ed19b636f35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636f2e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.587768:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3100030200/0x6d98ed19b636f35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636f2e expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.587778:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3100030200/0x6d98ed19b636f35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636f2e expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.587786:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3100030200, rc 0) 00000100:00100000:1.0:1787782698.588009:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922349568:0@lo:101: 00010000:00010000:1.0:1787782698.588025:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31013a1600/0x6d98ed19b636f2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f35 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.588034:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31013a1600/0x6d98ed19b636f2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636f35 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782698.588164:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922349696:0@lo:501: 00000100:00100000:1.0:1787782698.588194:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782698.588358:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922349696 00000100:00100000:2.0:1787782698.588362:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922349696 00000100:00100000:2.0:1787782698.588397:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787782698.588404:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:7631:x1874625922349696:12345-0@lo:501: 00000100:00100000:2.0:1787782698.588597:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:7631:x1874625922349696:12345-0@lo:501: Request processed in 192us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782698.588613:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787782698.588748:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310701b840 going to sleep for 11 seconds 00000100:00100000:1.0:1787782698.588762:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922349696:0@lo:501: 00000100:00100000:1.0:1787782698.588789:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922349824:0@lo:503: 00000100:00100000:1.0:1787782698.588838:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782698.588858:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310701b840 going to sleep for 11 seconds 00000100:00100000:2.0:1787782698.588953:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922349824 00000100:00100000:2.0:1787782698.588958:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922349824 00000100:00100000:2.0:1787782698.588987:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787782698.588994:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:7631:x1874625922349824:12345-0@lo:503: 00000100:00100000:2.0:1787782698.589144:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:7631:x1874625922349824:12345-0@lo:503: Request processed in 150us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782698.589151:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787782698.589407:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:7631:x1874625922349568:12345-0@lo:101: Request processed in 1687us (2935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782698.589414:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787782698.589891:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922349824:0@lo:503: 00000040:00080000:1.0:1787782698.590370:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787782698.590506:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922349952:0@lo:502: 00000100:00100000:1.0:1787782698.590553:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782698.590675:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310701b840 going to sleep for 11 seconds 00010000:00010000:3.0:1787782698.590912:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782698.590928:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636f20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6d98ed19b636f27 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.590937:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782698.590942:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636f20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x6d98ed19b636f27 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.590952:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x6d98ed19b636f27 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782698.590961:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636f20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x6d98ed19b636f27 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782698.590967:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787782698.591048:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636f20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d98ed19b636f27 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.591065:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782698.591110:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636f20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d98ed19b636f27 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.591118:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636f20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x6d98ed19b636f27 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.591132:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782698.591134:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782698.591136:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782698.591198:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782698.591210:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922350080:0@lo:103: 00000100:00100000:1.0:1787782698.591380:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782698.591563:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922349952 00000100:00100000:2.0:1787782698.591570:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922349952 00000100:00100000:2.0:1787782698.591622:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787782698.591639:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:7631:x1874625922349952:12345-0@lo:502: 00000100:00100000:2.0:1787782698.592040:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:7631:x1874625922349952:12345-0@lo:502: Request processed in 402us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782698.592048:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787782698.592163:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922349952:0@lo:502: 00000040:00080000:1.0:1787782698.592449:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787782698.592509:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787782698.592543:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787782698.592589:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787782698.592628:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787782698.592663:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787782698.592701:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922350208:0@lo:502: 00000100:00100000:1.0:1787782698.592737:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782698.592766:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310701b840 going to sleep for 11 seconds 00000100:00100000:2.0:1787782698.593129:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922350208 00000100:00100000:2.0:1787782698.593135:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922350208 00000100:00100000:2.0:1787782698.593167:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787782698.593174:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+13:7631:x1874625922350208:12345-0@lo:502: 00000100:00100000:2.0:1787782698.593745:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+13:7631:x1874625922350208:12345-0@lo:502: Request processed in 570us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782698.593752:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787782698.593892:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922350080 00000100:00100000:0.0:1787782698.593905:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922350080 00000100:00100000:0.0:1787782698.593959:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787782698.593967:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+13:3306:x1874625922350080:12345-0@lo:103: 00010000:00010000:0.0:1787782698.593986:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782698.594010:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31421fd800/0x6d98ed19b636f27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d98ed19b636f20 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.594026:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782698.594085:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+12:3306:x1874625922350080:12345-0@lo:103: Request processed in 119us (2705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782698.594092:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787782698.594206:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922350080:0@lo:103: 00000100:00100000:3.0:1787782698.594889:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd1e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922350208:0@lo:502: 00000040:00080000:3.0:1787782698.595084:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787782698.595347:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1787782698.595991:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787782698.596001:0:7639:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787782698.596008:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782698.596012:0:7639:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787782698.596018:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787782698.596033:0:7639:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8c3118418000) 00000020:00000080:0.0:1787782698.596058:0:7639:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787782698.596076:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787782698.596346:0:7639:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c310712b000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787782698.596355:0:7639:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787782698.596363:0:7639:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6d98ed19b636f43 00010000:00010000:0.0:1787782698.602043:0:7639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1787782698.602785:0:7639:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787782698.609370:0:7639:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787782698.609797:0:7639:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787782698.624642:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787782698.626595:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787782698.633783:0:7639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787782698.633797:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782698.633805:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782698.633814:0:7639:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787782698.633819:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782698.633833:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782698.633835:0:7639:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787782698.633838:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787782698.633840:0:7639:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787782698.633903:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782698.633907:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782698.633908:0:7639:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787782698.633911:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787782698.634134:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787782698.634159:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787782698.634181:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1600/0x6d98ed19b636f2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f35 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.634195:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31013a1600/0x6d98ed19b636f2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f35 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782698.634204:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c310712b000 from 1 10000000:01000000:1.0:1787782698.634207:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787782698.634253:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636f4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.634262:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636f4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.634274:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636f4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782698.634298:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922350336:0@lo:101: 00000100:00100000:1.0:1787782698.634370:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782698.634564:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310701b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787782698.636933:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922350336 00000100:00100000:2.0:1787782698.636944:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922350336 00000100:00100000:2.0:1787782698.637002:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787782698.637012:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:7631:x1874625922350336:12345-0@lo:101: 00010000:00010000:2.0:1787782698.637029:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782698.637045:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636f51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636f4a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.637074:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636f51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636f4a expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.637086:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636f51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636f4a expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.637112:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0a00, rc 0) 00000100:00100000:2.0:1787782698.637189:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:7631:x1874625922350336:12345-0@lo:101: Request processed in 179us (2819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782698.637197:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787782698.637338:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922350336:0@lo:101: 00010000:00010000:0.0:1787782698.637356:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636f4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f51 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.637368:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636f4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636f51 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782698.637494:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922350464:0@lo:501: 00000100:00100000:0.0:1787782698.637529:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782698.637559:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311f9bea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787782698.637648:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922350464 00000100:00100000:2.0:1787782698.637652:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922350464 00000100:00100000:2.0:1787782698.637670:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787782698.637739:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:7631:x1874625922350464:12345-0@lo:501: 00000100:00100000:2.0:1787782698.638026:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:7631:x1874625922350464:12345-0@lo:501: Request processed in 349us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782698.638034:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787782698.638521:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922350464:0@lo:501: 00000100:00100000:0.0:1787782698.638554:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922350592:0@lo:503: 00000100:00100000:0.0:1787782698.638591:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782698.638620:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311f9bea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787782698.639295:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922350592 00000100:00100000:2.0:1787782698.639300:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922350592 00000100:00100000:2.0:1787782698.639335:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787782698.639343:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:7631:x1874625922350592:12345-0@lo:503: 00000100:00100000:2.0:1787782698.640324:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:7631:x1874625922350592:12345-0@lo:503: Request processed in 980us (1730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782698.640334:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787782698.646515:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922350592:0@lo:503: 00000040:00080000:0.0:1787782698.649022:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787782698.649141:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922350720:0@lo:502: 00000100:00100000:0.0:1787782698.649223:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782698.649262:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311f9bea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787782698.649400:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922350720 00000100:00100000:1.0:1787782698.649407:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922350720 00000100:00100000:1.0:1787782698.649463:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787782698.649472:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:7631:x1874625922350720:12345-0@lo:502: 00000100:00100000:1.0:1787782698.649698:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:7631:x1874625922350720:12345-0@lo:502: Request processed in 226us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782698.649706:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787782698.649993:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d43c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922350720:0@lo:502: 00000040:00080000:2.0:1787782698.650269:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787782698.650320:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787782698.650346:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922350848:0@lo:502: 00000100:00100000:2.0:1787782698.650396:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782698.650424:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311863d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787782698.650533:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922350848 00000100:00100000:1.0:1787782698.650538:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922350848 00000100:00100000:1.0:1787782698.650572:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787782698.650581:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:7631:x1874625922350848:12345-0@lo:502: 00000100:00100000:1.0:1787782698.650718:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:7631:x1874625922350848:12345-0@lo:502: Request processed in 138us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782698.650725:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787782698.651513:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922350848:0@lo:502: 00000040:00080000:2.0:1787782698.651625:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787782698.651638:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787782698.652633:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787782698.652643:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782698.652645:0:7643:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787782698.652659:0:7643:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c310712b000 00000020:00000080:0.0:1787782698.652662:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787782698.652695:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787782698.652699:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782698.652701:0:7643:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787782698.652704:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787782698.652917:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787782698.652938:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787782698.652959:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636f4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f51 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.652970:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636f4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f51 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782698.653026:0:7631:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787782698.653029:0:7631:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c310712b000 10000000:01000000:2.0:1787782698.653033:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c310712b000 10000000:01000000:2.0:1787782698.653037:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787782698.653043:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c310712b000 from 1 10000000:01000000:2.0:1787782698.653046:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787782698.653080:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b636f58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.653088:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b636f58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.653161:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b636f58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782698.653183:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922350976:0@lo:101: 00000100:00100000:2.0:1787782698.653253:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782698.653532:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31063a49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782698.653783:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922350976 00000100:00100000:1.0:1787782698.653790:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922350976 00000100:00100000:1.0:1787782698.653911:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787782698.653923:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:7631:x1874625922350976:12345-0@lo:101: 00010000:00010000:1.0:1787782698.653934:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782698.653946:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31421fd400/0x6d98ed19b636f5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636f58 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.653968:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31421fd400/0x6d98ed19b636f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636f58 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.653980:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31421fd400/0x6d98ed19b636f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636f58 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.653989:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31421fd400, rc 0) 00000100:00100000:1.0:1787782698.654040:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:7631:x1874625922350976:12345-0@lo:101: Request processed in 119us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782698.654048:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787782698.654147:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922350976:0@lo:101: 00010000:00010000:2.0:1787782698.654160:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b636f58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f5f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.654170:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b636f58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636f5f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782698.654274:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922351104:0@lo:501: 00000100:00100000:2.0:1787782698.654300:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782698.654651:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31063a49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782698.654782:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922351104 00000100:00100000:0.0:1787782698.654788:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922351104 00000100:00100000:0.0:1787782698.654813:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787782698.654821:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+14:7631:x1874625922351104:12345-0@lo:501: 00000100:00100000:0.0:1787782698.655064:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+14:7631:x1874625922351104:12345-0@lo:501: Request processed in 243us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782698.655071:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787782698.655314:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922351104:0@lo:501: 00000100:00100000:2.0:1787782698.655348:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922351232:0@lo:503: 00000100:00100000:2.0:1787782698.655399:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782698.655418:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31063a49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782698.655555:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922351232 00000100:00100000:0.0:1787782698.655560:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922351232 00000100:00100000:0.0:1787782698.655579:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787782698.655585:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+14:7631:x1874625922351232:12345-0@lo:503: 00000100:00100000:0.0:1787782698.655741:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+14:7631:x1874625922351232:12345-0@lo:503: Request processed in 155us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782698.655748:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787782698.655900:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922351232:0@lo:503: 00000040:00080000:2.0:1787782698.656196:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787782698.656260:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922351360:0@lo:502: 00000100:00100000:2.0:1787782698.656293:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782698.656311:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311863d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787782698.656404:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922351360 00000100:00100000:0.0:1787782698.656408:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922351360 00000100:00100000:0.0:1787782698.656428:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787782698.656434:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+14:7631:x1874625922351360:12345-0@lo:502: 00000100:00100000:0.0:1787782698.656602:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+14:7631:x1874625922351360:12345-0@lo:502: Request processed in 167us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782698.656608:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787782698.656763:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922351360:0@lo:502: 00000040:00080000:2.0:1787782698.657023:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787782698.657068:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787782698.657137:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787782698.657189:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787782698.657240:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787782698.657292:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787782698.657331:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787782698.657366:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787782698.657632:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787782698.657673:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787782698.657721:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787782698.657771:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787782698.657809:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787782698.657951:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787782698.658016:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787782698.658054:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787782698.658089:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787782698.658171:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787782698.658300:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787782698.658341:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787782698.658489:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787782698.658530:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787782698.658566:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787782698.658615:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787782698.658652:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787782698.658753:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787782698.658818:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787782698.658990:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787782698.659025:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787782698.659074:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787782698.659138:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787782698.659175:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787782698.659210:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787782698.659258:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787782698.659310:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787782698.659359:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787782698.659466:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787782698.659514:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922351488:0@lo:502: 00000100:00100000:2.0:1787782698.659582:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782698.659636:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922351488 00000100:00100000:2.0:1787782698.659642:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922351488 00000100:00100000:2.0:1787782698.659688:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787782698.659698:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+14:7631:x1874625922351488:12345-0@lo:502: 00000100:00100000:2.0:1787782698.660084:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+14:7631:x1874625922351488:12345-0@lo:502: Request processed in 386us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782698.660092:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787782698.660208:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31063a49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782698.660371:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922351488:0@lo:502: 00000040:00080000:2.0:1787782698.660513:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787782698.660523:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787782698.661477:0:7644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787782698.661504:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8c3134384d28) 00000020:00000080:2.0:1787782698.661528:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1787782698.661603:0:7644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c310712b000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787782698.661608:0:7644:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c310712b000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787782698.661611:0:7644:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c310712b000 3 00010000:00080000:2.0:1787782698.661640:0:7644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c313438c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.115@tcp at head 00010000:00010000:2.0:1787782698.663545:0:7644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1787782698.666021:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787782698.667130:0:7644:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787782698.667146:0:7644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6d98ed19b636f6d 00000100:00080000:2.0:1787782698.667157:0:7644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787782698.667164:0:7644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c313438c000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787782698.667216:0:7644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3119e8ad00 x1874625922351616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787782698.667243:0:7644:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787782698.668790:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625922351616:0@lo:38: 00000100:00100000:3.0:1787782698.668873:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782698.669115:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922351616 00000100:00100000:2.0:1787782698.669122:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922351616 00000100:00100000:2.0:1787782698.669155:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787782698.669161:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874625922351616:12345-0@lo:38: 00010000:00080000:2.0:1787782698.669185:0:5853:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:2.0:1787782698.669210:0:5853:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6d98ed19b636f74 00000004:00100000:2.0:1787782698.669223:0:5853:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787782698.669248:0:5853:0:(import.c:65:import_set_state_nolock()) ffff8c313438a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782698.669308:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625922351616:12345-0@lo:38: Request processed in 146us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782698.669322:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787782698.669369:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119e8ad00 x1874625922351616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787782708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782698.669379:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787782698.669387:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787782698.669396:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787782698.669401:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787782698.669404:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c313438c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787782698.669411:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625922351616:0@lo:38: 00000040:00080000:2.0:1787782698.669567:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1787782698.669611:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1787782698.669636:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787782698.669648:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b636f58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f5f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.669659:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b636f58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f5f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787782698.669757:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787782698.669759:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787782698.669760:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782698.669762:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782698.669763:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782698.669765:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782698.669766:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782698.669768:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787782698.669769:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787782698.669771:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782698.669772:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787782698.669775:0:7631:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1787782698.669782:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787782698.669783:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787782698.669784:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782698.669785:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782698.669786:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782698.669787:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782698.669788:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782698.669789:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787782698.669789:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787782698.669790:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782698.669791:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787782698.669805:0:7631:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787782698.669817:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922351744:0@lo:253: 00000100:00100000:2.0:1787782698.669949:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782698.669967:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d0cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787782698.670009:0:7646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7646:1874625922351872:0@lo:901: 00000100:00100000:2.0:1787782698.670033:0:7646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782698.670059:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922351872 00000100:00100000:2.0:1787782698.670063:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922351872 00000100:00100000:2.0:1787782698.670124:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782698.670132:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7646:x1874625922351872:12345-0@lo:901: 00000100:00100000:2.0:1787782698.670433:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7646:x1874625922351872:12345-0@lo:901: Request processed in 301us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782698.670439:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787782698.670464:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782698.670476:0:7646:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d0c180 going to sleep for 11 seconds 00010000:00080000:2.0:1787782698.670492:0:7646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119e88000 x1874625922351872/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787782714 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782698.670501:0:7646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7646:1874625922351872:0@lo:901: 00000100:00100000:0.0:1787782698.670643:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922351744 00000100:00100000:0.0:1787782698.670652:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922351744 00000100:00100000:0.0:1787782698.670750:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787782698.670757:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+14:7631:x1874625922351744:12345-0@lo:253: 20000000:01000000:0.0:1787782698.670776:0:5845:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787782698.670789:0:5845:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787782698.679259:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787782698.679286:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625922352000:0@lo:400: 00000100:00100000:1.0:1787782698.679355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782698.679407:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922352000 00000100:00100000:1.0:1787782698.679415:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922352000 00000100:00100000:1.0:1787782698.679472:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787782698.679481:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625922352000:12345-0@lo:400: 00000100:00100000:1.0:1787782698.679530:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625922352000:12345-0@lo:400: Request processed in 50us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782698.679536:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787782698.679576:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119fd3480 x1874625922352000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782698.679590:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625922352000:0@lo:400: 00000100:00100000:1.0:1787782698.679624:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625922352128:0@lo:400: 00000100:00100000:1.0:1787782698.679647:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782698.679687:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922352128 00000100:00100000:1.0:1787782698.679691:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922352128 00000100:00100000:1.0:1787782698.679727:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787782698.679733:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625922352128:12345-0@lo:400: 00000100:00100000:1.0:1787782698.679768:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625922352128:12345-0@lo:400: Request processed in 35us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782698.679775:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787782698.679790:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787782698.679807:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119fd3480 x1874625922352128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782698.679817:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625922352128:0@lo:400: 00000100:00100000:1.0:1787782698.679884:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922352256:0@lo:400: 00000100:00100000:1.0:1787782698.679925:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782698.679962:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922352256 00000100:00100000:1.0:1787782698.679965:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922352256 00000100:00100000:1.0:1787782698.679996:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787782698.680002:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922352256:12345-0@lo:400: 00000100:00100000:1.0:1787782698.680036:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922352256:12345-0@lo:400: Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782698.680042:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787782698.680055:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787782698.680072:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c3119fd3480 x1874625922352256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782698.680082:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922352256:0@lo:400: 20000000:01000000:0.0:1787782698.707307:0:5845:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787782698.707328:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787782698.707440:0:5867:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787782698.707445:0:5867:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787782698.707476:0:5867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.707495:0:5867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636ecc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636ec5 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.707505:0:5867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f7b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.707542:0:5867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636ecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636ec5 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782698.707557:0:5867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636ecc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636ec5 expref: 14 pid: 5845 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782698.707589:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e52c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1874625922352384:0@lo:104: 00000100:00100000:1.0:1787782698.707657:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782698.707764:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922352384 00000100:00100000:0.0:1787782698.707772:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922352384 00000100:00100000:0.0:1787782698.707833:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787782698.707844:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+3:5867:x1874625922352384:12345-0@lo:104: 00010000:00010000:0.0:1787782698.707857:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b636ec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636ecc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.711188:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787782698.711205:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+3:5867:x1874625922352384:12345-0@lo:104: Request processed in 3359us (3543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782698.711227:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787782698.711338:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782698.711347:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b636ec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636ecc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.711371:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fc800 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:2.0:1787782698.711375:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b636ec5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636ecc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.711385:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b636ec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636ecc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782698.711401:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b636ec5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636ecc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782698.711407:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787782698.711454:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b636ec5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636ecc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.711470:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782698.711492:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b636ec5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636ecc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.711500:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b636ec5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636ecc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782698.711519:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782698.711521:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782698.711523:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782698.711921:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782698.711938:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922352512:0@lo:103: 00000100:00100000:0.0:1787782698.711985:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782698.712123:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107d8ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787782698.712146:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e52c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5867:1874625922352384:0@lo:104: 00010000:00010000:1.0:1787782698.712165:0:5867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782698.712341:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922352512 00000100:00100000:3.0:1787782698.712349:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922352512 00010000:00010000:3.0:1787782698.712377:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636ecc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636ec5 expref: 15 pid: 5845 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782698.712418:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787782698.712427:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3118517850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+15:3306:x1874625922352512:12345-0@lo:103: 00010000:00010000:3.0:1787782698.712439:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782698.712445:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636ecc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636ec5 expref: 15 pid: 5845 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.712479:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636ecc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636ec5 expref: 15 pid: 5845 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.712494:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636ecc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636ec5 expref: 15 pid: 5845 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.712508:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f7b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.712517:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f7b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787782698.712532:0:5837:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005087367s 00010000:00010000:3.0:1787782698.712537:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.712545:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.712552:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f7b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.712559:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.712565:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fcc00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787782698.712569:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.712577:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f7b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.712606:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f7b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782698.712616:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782698.712656:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3118517850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:3306:x1874625922352512:12345-0@lo:103: Request processed in 230us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782698.712664:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787782698.712800:0:5867:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.712808:0:5867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782698.712815:0:5867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f7b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782698.713013:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922352512:0@lo:103: 00000100:00100000:1.0:1787782698.740751:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+13:7631:x1874625922351744:12345-0@lo:253: Request processed in 69984us (70790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782698.740767:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787782698.740906:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:db359560-8e1a-42c0-a155-5e020d83d9a3:7631:1874625922351744:0@lo:253: 10000000:01000000:2.0:1787782698.740921:0:7631:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787782698.740925:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787782698.740927:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787782698.740928:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782698.740943:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782698.740945:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782698.740946:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782698.740947:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782698.740949:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787782698.740950:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787782698.740952:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782698.740953:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787782698.740970:0:7631:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787782698.758292:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787782698.758942:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787782698.759180:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787782698.760081:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787782698.761325:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787782698.762026:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787782698.766074:0:7631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787782699.054984:0:7631:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787782699.054993:0:7631:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787782699.055031:0:7631:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787782699.055088:0:7631:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787782699.055135:0:7631:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787782699.055153:0:7631:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787782699.378354:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782700.131539:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922352640:0@lo:13: 00000100:00100000:0.0:1787782700.131636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782700.135923:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922352640 00000100:00100000:0.0:1787782700.135937:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922352640 00000100:00100000:0.0:1787782700.135995:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787782700.136004:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922352640:12345-0@lo:13: 00002000:00000024:0.0:1787782700.136042:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782700.136141:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922352640:12345-0@lo:13: Request processed in 138us (4505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782700.136149:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787782700.136169:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787782700.136199:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3119e89a40 x1874625922352640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782700.136220:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922352640:0@lo:13: 00010000:00010000:1.0:1787782700.385274:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782701.411590:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782702.436476:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782703.464219:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782703.714809:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922352896:0@lo:400: 00000100:00100000:1.0:1787782703.714882:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782703.714962:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782703.714969:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922353024:0@lo:400: 00000100:00100000:1.0:1787782703.714994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782703.715037:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922352896 00000100:00100000:1.0:1787782703.715044:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922352896 00000100:00100000:1.0:1787782703.715089:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922353024 00000100:00100000:1.0:1787782703.715092:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922353024 00000100:00100000:1.0:1787782703.715139:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787782703.715149:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922352896:12345-0@lo:400: 00000100:00100000:1.0:1787782703.715215:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922352896:12345-0@lo:400: Request processed in 67us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782703.715222:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787782703.715237:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787782703.715243:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922353024:12345-0@lo:400: 00000100:00100000:1.0:1787782703.715269:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922353024:12345-0@lo:400: Request processed in 26us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782703.715275:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1787782703.715316:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31410e61c0 x1874625922353024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782703.715331:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922353024:0@lo:400: 00010000:00080000:1.0:1787782703.715341:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31410e6940 x1874625922352896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782703.715349:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922352896:0@lo:400: 00000100:00100000:0.0:1787782703.715796:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922352768:0@lo:400: 00000100:00100000:0.0:1787782703.715837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782703.715877:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922353280:0@lo:400: 00000100:00100000:0.0:1787782703.715905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782703.715925:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787782703.715931:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922353152:0@lo:400: 00000100:00100000:0.0:1787782703.715956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787782703.715988:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782703.716001:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922353152 00000100:00100000:0.0:1787782703.716005:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922353152 00000100:00100000:0.0:1787782703.716051:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787782703.716058:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922353152:12345-0@lo:400: 00000100:00100000:0.0:1787782703.716117:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922353152:12345-0@lo:400: Request processed in 60us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782703.716123:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787782703.716142:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787782703.716161:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31410e5a40 x1874625922353152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782703.716185:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922353152:0@lo:400: 00000100:00100000:0.0:1787782703.716203:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922353280 00000100:00100000:0.0:1787782703.716206:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922353280 00000100:00100000:0.0:1787782703.716233:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787782703.716240:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922353280:12345-0@lo:400: 00000100:00100000:0.0:1787782703.716274:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922353280:12345-0@lo:400: Request processed in 35us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782703.716280:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787782703.716296:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787782703.716309:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31410e4f00 x1874625922353280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782703.716317:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922353280:0@lo:400: 00000100:00100000:1.0:1787782703.716546:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922352768 00000100:00100000:1.0:1787782703.716551:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922352768 00000100:00100000:1.0:1787782703.716587:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787782703.716594:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:3305:x1874625922352768:12345-0@lo:400: 00000100:00100000:1.0:1787782703.716638:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:3305:x1874625922352768:12345-0@lo:400: Request processed in 44us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782703.716644:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787782703.716729:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922352768:0@lo:400: 00010000:00010000:0.0:1787782704.484266:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787782704.565476:0:7989:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1787782704.737249:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787782704.737257:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c3129b5d800 from 30 10000000:01000000:0.0:1787782704.737263:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787782704.737309:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3100031e00/0x6d98ed19b636f82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782704.737328:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3100031e00/0x6d98ed19b636f82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782704.738444:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3100031e00/0x6d98ed19b636f82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782704.738473:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922353408:0@lo:101: 00000100:00100000:0.0:1787782704.738543:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782704.738593:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2240 going to sleep for 11 seconds 00000100:00100000:1.0:1787782704.738602:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922353408 00000100:00100000:1.0:1787782704.738610:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922353408 00000100:00100000:1.0:1787782704.738665:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787782704.738675:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+13:5848:x1874625922353408:12345-0@lo:101: 00010000:00010000:1.0:1787782704.738687:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782704.738702:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31421fd000/0x6d98ed19b636f89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636f82 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782704.738726:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31421fd000/0x6d98ed19b636f89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636f82 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782704.738736:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31421fd000/0x6d98ed19b636f89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636f82 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782704.738744:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31421fd000, rc 0) 00000100:00100000:1.0:1787782704.738784:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+14:5848:x1874625922353408:12345-0@lo:101: Request processed in 110us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782704.738790:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787782704.738830:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922353408:0@lo:101: 00010000:00010000:1.0:1787782704.738844:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3100031e00/0x6d98ed19b636f82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f89 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782704.738852:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3100031e00/0x6d98ed19b636f82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636f89 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782704.738910:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922353536:0@lo:501: 00000100:00100000:1.0:1787782704.738934:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782704.738948:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107068600 going to sleep for 11 seconds 00000100:00100000:1.0:1787782704.738960:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922353536 00000100:00100000:1.0:1787782704.738963:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922353536 00000100:00100000:1.0:1787782704.738981:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787782704.738987:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:5848:x1874625922353536:12345-0@lo:501: 00000100:00100000:1.0:1787782704.739349:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:5848:x1874625922353536:12345-0@lo:501: Request processed in 360us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782704.739356:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787782704.739387:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922353536:0@lo:501: 00000100:00100000:1.0:1787782704.739426:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922353664:0@lo:503: 00000100:00100000:1.0:1787782704.739463:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782704.739491:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107068600 going to sleep for 11 seconds 00000100:00100000:0.0:1787782704.739524:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922353664 00000100:00100000:0.0:1787782704.739528:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922353664 00000100:00100000:0.0:1787782704.739557:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787782704.739563:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:5848:x1874625922353664:12345-0@lo:503: 00000100:00100000:0.0:1787782704.739845:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:5848:x1874625922353664:12345-0@lo:503: Request processed in 281us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782704.739851:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787782704.739921:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922353664:0@lo:503: 00000100:00100000:1.0:1787782704.742929:0:8005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8005:1874625922353792:0@lo:502: 00000100:00100000:1.0:1787782704.743013:0:8005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782704.743062:0:8005:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d0c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782704.744767:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922353792 00000100:00100000:2.0:1787782704.744778:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922353792 00000100:00100000:2.0:1787782704.744823:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787782704.744833:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+14:8005:x1874625922353792:12345-0@lo:502: 00000100:00100000:2.0:1787782704.745222:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+14:8005:x1874625922353792:12345-0@lo:502: Request processed in 388us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782704.745230:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787782704.745899:0:8005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8005:1874625922353792:0@lo:502: 00000100:00100000:1.0:1787782704.745965:0:8005:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8005:1874625922353920:0@lo:502: 00000100:00100000:1.0:1787782704.746009:0:8005:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782704.746054:0:8005:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d0c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782704.748611:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922353920 00000100:00100000:2.0:1787782704.748625:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922353920 00000100:00100000:2.0:1787782704.748688:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787782704.748699:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:8005:x1874625922353920:12345-0@lo:502: 00000100:00100000:2.0:1787782704.748967:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:8005:x1874625922353920:12345-0@lo:502: Request processed in 269us (2957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782704.748975:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787782704.749429:0:8005:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e6940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8005:1874625922353920:0@lo:502: 00000040:00080000:1.0:1787782704.749467:0:8005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787782704.750223:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787782704.750243:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787782704.750253:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3100031e00/0x6d98ed19b636f82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f89 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782704.750264:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3100031e00/0x6d98ed19b636f82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f89 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782704.750274:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787782704.750276:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787782704.750279:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787782704.750308:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636f90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782704.750322:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636f90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782704.750331:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636f90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782704.750360:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922354048:0@lo:101: 00000100:00100000:0.0:1787782704.750419:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782704.750454:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782704.750539:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922354048 00000100:00100000:1.0:1787782704.750544:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922354048 00000100:00100000:1.0:1787782704.750582:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787782704.750591:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+14:5848:x1874625922354048:12345-0@lo:101: 00010000:00010000:1.0:1787782704.750602:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782704.750615:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636f90 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782704.750637:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636f90 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782704.750647:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636f90 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782704.750656:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31421fcc00, rc 0) 00000100:00100000:1.0:1787782704.750701:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922354048:12345-0@lo:101: Request processed in 111us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782704.750707:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787782704.750859:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922354048:0@lo:101: 00010000:00010000:0.0:1787782704.750872:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636f90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f97 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782704.750881:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636f90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636f97 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782704.750923:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922354176:0@lo:501: 00000100:00100000:0.0:1787782704.750948:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782704.750972:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782704.751750:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922354176 00000100:00100000:1.0:1787782704.751756:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922354176 00000100:00100000:1.0:1787782704.751791:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787782704.751799:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922354176:12345-0@lo:501: 00000100:00100000:1.0:1787782704.752059:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922354176:12345-0@lo:501: Request processed in 260us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782704.752067:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787782704.752127:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922354176:0@lo:501: 00000100:00100000:1.0:1787782704.752163:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922354304:0@lo:503: 00000100:00100000:1.0:1787782704.752205:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782704.752231:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d0ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787782704.752242:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922354304 00000100:00100000:1.0:1787782704.752245:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922354304 00000100:00100000:1.0:1787782704.752264:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787782704.752270:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922354304:12345-0@lo:503: 00000100:00100000:1.0:1787782704.753938:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922354304:12345-0@lo:503: Request processed in 1661us (1725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782704.753950:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787782704.754016:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922354304:0@lo:503: 00000100:00100000:2.0:1787782704.758267:0:8006:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8006:1874625922354432:0@lo:502: 00000100:00100000:2.0:1787782704.758346:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782704.758389:0:8006:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782704.758540:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922354432 00000100:00100000:3.0:1787782704.758547:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922354432 00000100:00100000:3.0:1787782704.758630:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787782704.758641:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+15:8006:x1874625922354432:12345-0@lo:502: 00000100:00100000:3.0:1787782704.759014:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+15:8006:x1874625922354432:12345-0@lo:502: Request processed in 373us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782704.759022:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787782704.759582:0:8006:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8006:1874625922354432:0@lo:502: 00000020:01000000:2.0:1787782704.759629:0:8006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782704.759637:0:8006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782704.759640:0:8006:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787782704.759651:0:8006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787782704.759653:0:8006:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787782704.759677:0:8006:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8006:1874625922354560:0@lo:502: 00000100:00100000:2.0:1787782704.759713:0:8006:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782704.759745:0:8006:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782704.759797:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922354560 00000100:00100000:1.0:1787782704.759802:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922354560 00000100:00100000:1.0:1787782704.759868:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787782704.759876:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+15:8006:x1874625922354560:12345-0@lo:502: 00000100:00100000:1.0:1787782704.760062:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+15:8006:x1874625922354560:12345-0@lo:502: Request processed in 186us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782704.760070:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787782704.760215:0:8006:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8006:1874625922354560:0@lo:502: 00000020:01000000:3.0:1787782704.760233:0:8006:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782704.760238:0:8006:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782704.760240:0:8006:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787782704.760244:0:8006:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787782704.760434:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787782704.760454:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787782704.760465:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636f90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f97 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782704.760476:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636f90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636f97 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782704.760496:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787782704.760499:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c311846c800 from 30 10000000:01000000:0.0:1787782704.760502:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787782704.760525:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3100030600/0x6d98ed19b636f9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782704.760533:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3100030600/0x6d98ed19b636f9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782704.760541:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3100030600/0x6d98ed19b636f9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782704.760554:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922354688:0@lo:101: 00000100:00100000:0.0:1787782704.760584:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782704.760648:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2780 going to sleep for 11 seconds 00000100:00100000:3.0:1787782704.760685:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922354688 00000100:00100000:3.0:1787782704.760690:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922354688 00000100:00100000:3.0:1787782704.760763:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787782704.760771:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922354688:12345-0@lo:101: 00010000:00010000:3.0:1787782704.760786:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782704.760803:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636fa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636f9e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782704.760824:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636fa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636f9e expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782704.760835:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636fa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636f9e expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782704.760844:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31029f4c00, rc 0) 00000100:00100000:3.0:1787782704.760886:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922354688:12345-0@lo:101: Request processed in 116us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782704.760891:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787782704.760951:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922354688:0@lo:101: 00010000:00010000:0.0:1787782704.760963:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3100030600/0x6d98ed19b636f9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636fa5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782704.760971:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3100030600/0x6d98ed19b636f9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636fa5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782704.761010:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922354816:0@lo:501: 00000100:00100000:0.0:1787782704.761034:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782704.762503:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2780 going to sleep for 11 seconds 00000100:00100000:2.0:1787782704.762785:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922354816 00000100:00100000:2.0:1787782704.762793:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922354816 00000100:00100000:2.0:1787782704.762829:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787782704.762836:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922354816:12345-0@lo:501: 00000100:00100000:2.0:1787782704.763119:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922354816:12345-0@lo:501: Request processed in 282us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782704.763127:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787782704.763225:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922354816:0@lo:501: 00000100:00100000:0.0:1787782704.763265:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922354944:0@lo:503: 00000100:00100000:0.0:1787782704.763312:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782704.763352:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2780 going to sleep for 11 seconds 00000100:00100000:2.0:1787782704.763458:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922354944 00000100:00100000:2.0:1787782704.763463:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922354944 00000100:00100000:2.0:1787782704.763481:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787782704.763486:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922354944:12345-0@lo:503: 00000100:00100000:2.0:1787782704.763628:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922354944:12345-0@lo:503: Request processed in 141us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782704.763635:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787782704.763712:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922354944:0@lo:503: 00000100:00100000:0.0:1787782704.764165:0:8008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8008:1874625922355072:0@lo:502: 00000100:00100000:0.0:1787782704.764201:0:8008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782704.764216:0:8008:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2300 going to sleep for 11 seconds 00000100:00100000:2.0:1787782704.764268:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922355072 00000100:00100000:2.0:1787782704.764273:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922355072 00000100:00100000:2.0:1787782704.764290:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787782704.764296:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:8008:x1874625922355072:12345-0@lo:502: 00000100:00100000:2.0:1787782704.764488:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:8008:x1874625922355072:12345-0@lo:502: Request processed in 190us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782704.764496:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787782704.764613:0:8008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8008:1874625922355072:0@lo:502: 00000100:00100000:0.0:1787782704.764653:0:8008:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8008:1874625922355200:0@lo:502: 00000100:00100000:0.0:1787782704.764685:0:8008:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782704.764714:0:8008:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2300 going to sleep for 11 seconds 00000100:00100000:2.0:1787782704.764763:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922355200 00000100:00100000:2.0:1787782704.764767:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922355200 00000100:00100000:2.0:1787782704.764790:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787782704.764796:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:8008:x1874625922355200:12345-0@lo:502: 00000100:00100000:2.0:1787782704.764921:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:8008:x1874625922355200:12345-0@lo:502: Request processed in 124us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782704.764927:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787782704.764999:0:8008:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8008:1874625922355200:0@lo:502: 00000040:00080000:0.0:1787782704.765017:0:8008:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787782704.765180:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787782704.765195:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787782704.765204:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3100030600/0x6d98ed19b636f9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636fa5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782704.765215:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3100030600/0x6d98ed19b636f9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636fa5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782704.765226:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787782704.765228:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c311846c800 from 5 10000000:01000000:2.0:1787782704.765231:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787782704.765255:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782704.765263:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782704.765271:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782704.765283:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922355328:0@lo:101: 00000100:00100000:2.0:1787782704.765308:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782704.765416:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922355328 00000100:00100000:0.0:1787782704.765420:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922355328 00000100:00100000:0.0:1787782704.765438:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787782704.765444:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922355328:12345-0@lo:101: 00010000:00010000:0.0:1787782704.765452:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782704.765463:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3100030e00/0x6d98ed19b636fb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636fac expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782704.765483:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3100030e00/0x6d98ed19b636fb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636fac expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782704.765493:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3100030e00/0x6d98ed19b636fb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636fac expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782704.765501:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3100030e00, rc 0) 00000100:00100000:0.0:1787782704.765531:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922355328:12345-0@lo:101: Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782704.765537:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787782704.765582:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782704.765604:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922355328:0@lo:101: 00010000:00010000:2.0:1787782704.765624:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636fb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782704.765632:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636fb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782704.765672:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922355456:0@lo:256: 00000100:00100000:2.0:1787782704.765701:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782704.765717:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782704.765784:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922355456 00000100:00100000:0.0:1787782704.765788:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922355456 00000100:00100000:0.0:1787782704.765804:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787782704.765810:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922355456:12345-0@lo:256: 20000000:01000000:0.0:1787782704.765822:0:5845:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787782704.765838:0:5845:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787782704.765841:0:5845:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787782704.765912:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922355456:12345-0@lo:256: Request processed in 100us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782704.765918:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787782704.766207:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922355456:0@lo:256: 10000000:01000000:2.0:1787782704.766247:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787782704.766253:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636fb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782704.766261:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636fb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782704.766268:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787782704.766269:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787782704.766272:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787782704.766287:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636fba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782704.766294:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636fba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782704.766302:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636fba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782704.766314:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922355584:0@lo:101: 00000100:00100000:2.0:1787782704.766463:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782704.766487:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782704.766534:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922355584 00000100:00100000:0.0:1787782704.766539:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922355584 00000100:00100000:0.0:1787782704.766559:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787782704.766566:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922355584:12345-0@lo:101: 00010000:00010000:0.0:1787782704.766573:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782704.766582:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3100031a00/0x6d98ed19b636fc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636fba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782704.766598:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3100031a00/0x6d98ed19b636fc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636fba expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782704.766606:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3100031a00/0x6d98ed19b636fc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636fba expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782704.766614:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3100031a00, rc 0) 00000100:00100000:0.0:1787782704.766654:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922355584:12345-0@lo:101: Request processed in 88us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782704.766665:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787782704.766804:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922355584:0@lo:101: 00010000:00010000:2.0:1787782704.766815:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636fba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636fc1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782704.766823:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636fba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636fc1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782704.766868:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922355712:0@lo:501: 00000100:00100000:2.0:1787782704.766894:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782704.766920:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782704.766967:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922355712 00000100:00100000:0.0:1787782704.766971:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922355712 00000100:00100000:0.0:1787782704.766988:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787782704.766994:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922355712:12345-0@lo:501: 00000100:00100000:0.0:1787782704.767267:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922355712:12345-0@lo:501: Request processed in 271us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782704.767273:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787782704.767374:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922355712:0@lo:501: 00000100:00100000:2.0:1787782704.767410:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922355840:0@lo:503: 00000100:00100000:2.0:1787782704.767446:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782704.767466:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782704.767478:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922355840 00000100:00100000:2.0:1787782704.767482:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922355840 00000100:00100000:2.0:1787782704.767500:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787782704.767506:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922355840:12345-0@lo:503: 00000100:00100000:2.0:1787782704.767791:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922355840:12345-0@lo:503: Request processed in 284us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782704.767797:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787782704.767835:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922355840:0@lo:503: 00000100:00100000:2.0:1787782704.768050:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8009:1874625922355968:0@lo:502: 00000100:00100000:2.0:1787782704.768091:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782704.768145:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922355968 00000100:00100000:2.0:1787782704.768149:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922355968 00000100:00100000:2.0:1787782704.768166:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787782704.768172:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:8009:x1874625922355968:12345-0@lo:502: 00000100:00100000:2.0:1787782704.768387:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:8009:x1874625922355968:12345-0@lo:502: Request processed in 214us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782704.768394:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787782704.768437:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787782704.768450:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8009:1874625922355968:0@lo:502: 00000020:01000000:2.0:1787782704.768471:0:8009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787782704.768478:0:8009:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787782704.768485:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782704.768487:0:8009:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787782704.768491:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787782704.768495:0:8009:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.115@tcp to nid 0x20000c0a8ca73 (192.168.202.115@tcp) 00000020:01000000:2.0:1787782704.768518:0:8009:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787782704.768522:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787782704.768538:0:8009:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c3134383370) 00000020:00000080:2.0:1787782704.768559:0:8009:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787782704.768565:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787782704.768634:0:8009:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787782704.768639:0:8009:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787782704.768646:0:8009:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d98ed19b636fcf 00010000:00080000:2.0:1787782704.768677:0:8009:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c31061ee800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:2.0:1787782704.768902:0:8009:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787782704.769214:0:8009:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787782704.769226:0:8009:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787782704.769723:0:8009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787782704.769926:0:8009:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787782704.769974:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787782704.770029:0:8009:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787782704.779540:0:8010:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787782704.779548:0:8010:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787782704.785560:0:8009:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787782704.785577:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787782704.785616:0:8009:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787782704.785641:0:8009:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d98ed19b636fd6 00000100:00080000:2.0:1787782704.785652:0:8009:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787782704.785659:0:8009:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c31061ee800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787782704.785693:0:8009:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c3119e883c0 x1874625922356096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787782704.785722:0:8009:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1787782704.785787:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922356096:0@lo:8: 00000100:00100000:1.0:1787782704.785873:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782704.785963:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922356096 00000100:00100000:3.0:1787782704.785977:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922356096 00000100:00100000:3.0:1787782704.786017:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787782704.786025:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3303:x1874625922356096:12345-0@lo:8: 00010000:00080000:3.0:1787782704.786050:0:6967:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:3.0:1787782704.786076:0:6967:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d98ed19b636fdd 00002000:00100000:3.0:1787782704.786090:0:6967:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c3132185000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113937 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787782704.786115:0:6967:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1787782704.786118:0:6967:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787782704.786231:0:6967:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787782704.786390:0:6967:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787782704.786438:0:6967:0:(import.c:65:import_set_state_nolock()) ffff8c3132187800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787782704.786491:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1874625922356096:12345-0@lo:8: Request processed in 465us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782704.786509:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787782704.786550:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3119e883c0 x1874625922356096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787782714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782704.786559:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787782704.786566:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787782704.786572:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787782704.786576:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787782704.786578:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c31061ee800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787782704.786591:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787782704.786596:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922356096:0@lo:8: 00000004:00080000:1.0:1787782704.786787:0:8010:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787782704.786889:0:8010:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 189456793007ns, next at 0ns, rc = 0 00000020:01000000:2.0:1787782704.794282:0:8009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782704.794290:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782704.794293:0:8009:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787782704.794296:0:8009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782704.794300:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782704.794301:0:8009:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787782704.794304:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787782704.794306:0:8009:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787782704.794946:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922356352:0@lo:400: 00000100:00100000:3.0:1787782704.795013:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782704.795051:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787782704.795057:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922356480:0@lo:400: 00000100:00100000:3.0:1787782704.795111:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782704.795149:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922356352 00000100:00100000:3.0:1787782704.795155:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922356352 00000100:00100000:3.0:1787782704.795194:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922356480 00000100:00100000:3.0:1787782704.795198:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922356480 00000100:00100000:3.0:1787782704.795221:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787782704.795228:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922356352:12345-0@lo:400: 00000100:00100000:3.0:1787782704.795277:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922356352:12345-0@lo:400: Request processed in 50us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782704.795283:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787782704.795301:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787782704.795307:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f38bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922356480:12345-0@lo:400: 00000100:00100000:3.0:1787782704.795348:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f38bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922356480:12345-0@lo:400: Request processed in 42us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782704.795354:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1787782704.795392:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31187a8000 x1874625922356480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782704.795416:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922356480:0@lo:400: 00010000:00080000:3.0:1787782704.795428:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31187a83c0 x1874625922356352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782704.795437:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922356352:0@lo:400: 00000100:00100000:0.0:1787782704.795870:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922356608:0@lo:400: 00000100:00100000:0.0:1787782704.795901:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782704.795928:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787782704.795933:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922356736:0@lo:400: 00000100:00100000:0.0:1787782704.795953:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782704.795980:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922356736 00000100:00100000:0.0:1787782704.795983:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922356736 00000100:00100000:0.0:1787782704.796005:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787782704.796011:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922356736:12345-0@lo:400: 00000100:00100000:0.0:1787782704.796040:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922356736:12345-0@lo:400: Request processed in 30us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782704.796046:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787782704.796069:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31187a8b40 x1874625922356736/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782704.796078:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922356736:0@lo:400: 00000100:00100000:2.0:1787782704.797561:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8009:1874625922356224:0@lo:502: 00000100:00100000:2.0:1787782704.797615:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782704.797649:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31346c59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782704.797666:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922356224 00000100:00100000:2.0:1787782704.797671:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922356224 00000100:00100000:2.0:1787782704.797701:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787782704.797708:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:8009:x1874625922356224:12345-0@lo:502: 00000100:00100000:2.0:1787782704.797894:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:8009:x1874625922356224:12345-0@lo:502: Request processed in 185us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782704.797900:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787782704.797953:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8009:1874625922356224:0@lo:502: 00000020:01000000:2.0:1787782704.797980:0:8009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782704.797986:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782704.797988:0:8009:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787782704.797992:0:8009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1787782704.798118:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787782704.798134:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787782704.798142:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636fba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636fc1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782704.798153:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636fba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636fc1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782704.798162:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787782704.798164:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c31091e8000 from 1 10000000:01000000:2.0:1787782704.798167:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787782704.798189:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636fe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782704.798197:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636fe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782704.798206:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636fe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782704.798217:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922356864:0@lo:101: 00000100:00100000:2.0:1787782704.798240:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782704.798255:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31346c59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782704.798267:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922356864 00000100:00100000:2.0:1787782704.798270:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922356864 00000100:00100000:2.0:1787782704.798292:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787782704.798297:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922356864:12345-0@lo:101: 00010000:00010000:2.0:1787782704.798305:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782704.798315:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31013a1200/0x6d98ed19b636feb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b636fe4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782704.798333:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a1200/0x6d98ed19b636feb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b636fe4 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782704.798343:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31013a1200/0x6d98ed19b636feb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636fe4 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782704.798350:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1200, rc 0) 00000100:00100000:2.0:1787782704.798373:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922356864:12345-0@lo:101: Request processed in 76us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782704.798378:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787782704.798415:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922356864:0@lo:101: 00010000:00010000:2.0:1787782704.798427:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636fe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636feb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782704.798435:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636fe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636feb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782704.798473:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922356992:0@lo:501: 00000100:00100000:2.0:1787782704.798497:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782704.798509:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31346c59c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782704.798519:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922356992 00000100:00100000:2.0:1787782704.798522:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922356992 00000100:00100000:2.0:1787782704.798541:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787782704.798553:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922356992:12345-0@lo:501: 00000100:00100000:2.0:1787782704.798726:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922356992:12345-0@lo:501: Request processed in 173us (227us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787782704.798733:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787782704.798760:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922356992:0@lo:501: 10000000:01000000:2.0:1787782704.798779:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787782704.798783:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636fe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636feb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782704.798790:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636fe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636feb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782704.798934:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922356608 00000100:00100000:3.0:1787782704.798939:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922356608 00000100:00100000:3.0:1787782704.798970:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787782704.798978:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922356608:12345-0@lo:400: 00000100:00100000:3.0:1787782704.799023:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922356608:12345-0@lo:400: Request processed in 47us (3121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782704.799029:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787782704.799736:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31187a8f00 x1874625922356608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782704.799764:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922356608:0@lo:400: 00000004:00080000:2.0:1787782704.844453:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787782704.886548:0:8012:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787782704.886585:0:8012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e89a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8012:1874625922357248:0@lo:7: 00000100:00100000:3.0:1787782704.886638:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922357120:0@lo:13: 00000100:00100000:2.0:1787782704.886663:0:8012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782704.886721:0:8012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3109a77a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787782704.886742:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922357248 00000100:00100000:2.0:1787782704.886750:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922357248 00000100:00100000:3.0:1787782704.886804:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782704.886807:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787782704.886816:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8012:x1874625922357248:12345-0@lo:7: 00000100:00100000:0.0:1787782704.887042:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922357120 00000100:00100000:0.0:1787782704.887046:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922357120 00000100:00100000:0.0:1787782704.887065:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787782704.887070:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f38b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874625922357120:12345-0@lo:13: 00002000:00000024:0.0:1787782704.887088:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00010000:00080000:3.0:1787782704.887231:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3119e8ad00 x1874625922357120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782704.887251:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922357120:0@lo:13: 00000100:00100000:0.0:1787782704.887421:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f38b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874625922357120:12345-0@lo:13: Request processed in 93us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782704.887429:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787782704.888206:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1787782704.893249:0:6967:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787782704.893256:0:6967:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787782704.893522:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8012:x1874625922357248:12345-0@lo:7: Request processed in 6702us (6854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782704.893532:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787782704.893596:0:8012:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3119e89a40 x1874625922357248/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787782720 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782704.893612:0:8012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e89a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8012:1874625922357248:0@lo:7: 00000004:00080000:3.0:1787782704.893636:0:8012:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787782704.893676:0:8012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f38a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8012:1874625922357376:0@lo:5: 00000100:00100000:3.0:1787782704.893707:0:8012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782704.893761:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922357376 00000100:00100000:3.0:1787782704.893765:0:8012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3108ac1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782704.893768:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922357376 00000100:00100000:0.0:1787782704.893929:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787782704.893939:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f38a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8012:x1874625922357376:12345-0@lo:5: 00002000:00080000:0.0:1787782704.893976:0:6697:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787782704.893980:0:6697:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787782704.894291:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f38a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8012:x1874625922357376:12345-0@lo:5: Request processed in 354us (582us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787782704.894298:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787782704.894365:0:8012:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f38a940 x1874625922357376/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787782720 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782704.894386:0:8012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f38a940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8012:1874625922357376:0@lo:5: 00000004:00080000:2.0:1787782704.894395:0:8012:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787782704.894435:0:8012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8012:1874625922357504:0@lo:700: 00000100:00100000:2.0:1787782704.894463:0:8012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782704.894479:0:8012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3109a77180 going to sleep for 11 seconds 00000100:00100000:1.0:1787782704.894663:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922357504 00000100:00100000:1.0:1787782704.894668:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922357504 00000100:00100000:1.0:1787782704.894699:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787782704.894704:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8012:x1874625922357504:12345-0@lo:700: 00000100:00100000:1.0:1787782704.894731:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e61c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6705:1874625922357632:0@lo:700: 00000100:00100000:1.0:1787782704.894757:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782704.894772:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31063a4480 going to sleep for 11 seconds 00000100:00100000:1.0:1787782704.894786:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922357632 00000100:00100000:1.0:1787782704.894788:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922357632 00000100:00100000:1.0:1787782704.894805:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787782704.894809:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:6705:x1874625922357632:12345-0@lo:700: 40000000:02000000:0.0:1787782704.913662:0:5859:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787782704.916906:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:6705:x1874625922357632:12345-0@lo:700: Request processed in 22086us (22138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782704.916921:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787782704.916933:0:6705:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31410e61c0 x1874625922357632/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787782720 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782704.916947:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e61c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6705:1874625922357632:0@lo:700: 40000000:02000000:0.0:1787782704.916960:0:6705:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1787782705.046257:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1787782705.046281:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787782705.046477:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8012:x1874625922357504:12345-0@lo:700: Request processed in 151766us (152007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782705.046488:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787782705.046703:0:8012:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3119e88f00 x1874625922357504/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787782720 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782705.046715:0:8012:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787782705.046729:0:8012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8012:1874625922357504:0@lo:700: 00000004:02000040:3.0:1787782705.142772:0:8012:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1787782705.158318:0:8012:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8012:1874625922357760:0@lo:5: 00000100:00100000:2.0:1787782705.158384:0:8012:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782705.158453:0:8012:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3103ed4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787782705.159946:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922357760 00000100:00100000:3.0:1787782705.159958:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922357760 00000100:00100000:3.0:1787782705.160033:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787782705.160045:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8012:x1874625922357760:12345-0@lo:5: 00002000:00080000:3.0:1787782705.171745:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787782705.171768:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787782705.176468:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8012:x1874625922357760:12345-0@lo:5: Request processed in 16418us (18075us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787782705.176481:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787782705.176533:0:8012:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3119e8ad00 x1874625922357760/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787782721 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782705.176550:0:8012:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8012:1874625922357760:0@lo:5: 00000004:00080000:2.0:1787782705.176565:0:8012:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1787782705.249327:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922357888:0@lo:13: 00000100:00100000:1.0:1787782705.249417:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782705.249489:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922357888 00000100:00100000:1.0:1787782705.249497:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922357888 00000100:00100000:1.0:1787782705.249548:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787782705.249556:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922357888:12345-0@lo:13: 00002000:00000024:1.0:1787782705.249589:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782705.249631:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922357888:12345-0@lo:13: Request processed in 76us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782705.249638:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787782705.249676:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31410e4000 x1874625922357888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782705.249694:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922357888:0@lo:13: 00000100:00080000:3.0:1787782705.256310:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787782705.506592:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782706.532927:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782707.555672:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782708.578517:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787782709.595403:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787782709.602979:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782709.857572:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625922358144:0@lo:400: 00000100:00100000:0.0:1787782709.857654:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782709.857715:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922358656:0@lo:400: 00000100:00100000:0.0:1787782709.857744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782709.857777:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787782709.857783:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922358016:0@lo:400: 00000100:00100000:0.0:1787782709.857810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782709.857832:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922358528:0@lo:400: 00000100:00100000:0.0:1787782709.857852:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782709.857879:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922358144 00000100:00100000:0.0:1787782709.857885:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922358144 00000100:00100000:0.0:1787782709.857926:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922358528 00000100:00100000:0.0:1787782709.857929:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922358528 00000100:00100000:0.0:1787782709.857961:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787782709.857972:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625922358144:12345-0@lo:400: 00000100:00100000:0.0:1787782709.858030:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625922358144:12345-0@lo:400: Request processed in 60us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782709.858036:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787782709.858052:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787782709.858059:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922358528:12345-0@lo:400: 00000100:00100000:0.0:1787782709.858086:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922358528:12345-0@lo:400: Request processed in 28us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782709.858092:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787782709.858160:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f3d70c0 x1874625922358528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782709.858176:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922358528:0@lo:400: 00010000:00080000:0.0:1787782709.858203:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f3d4780 x1874625922358144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782709.858211:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625922358144:0@lo:400: 00000100:00100000:3.0:1787782709.858299:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922358656 00000100:00100000:3.0:1787782709.858304:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922358656 00000100:00100000:3.0:1787782709.858342:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787782709.858349:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922358656:12345-0@lo:400: 00000100:00100000:3.0:1787782709.858405:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922358656:12345-0@lo:400: Request processed in 57us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782709.858411:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787782709.858435:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787782709.858439:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787782709.858456:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f3d5a40 x1874625922358656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782709.858464:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787782709.858476:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922358656:0@lo:400: 00000100:00100000:1.0:1787782709.858647:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922358272:0@lo:400: 00000100:00100000:1.0:1787782709.858684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782709.858715:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782709.858722:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922358400:0@lo:400: 00000100:00100000:1.0:1787782709.858746:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782709.859706:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922358272 00000100:00100000:0.0:1787782709.859714:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922358272 00000100:00100000:0.0:1787782709.859757:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787782709.859765:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922358272:12345-0@lo:400: 00000100:00100000:0.0:1787782709.859822:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922358272:12345-0@lo:400: Request processed in 57us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782709.859828:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787782709.859864:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f3d4000 x1874625922358272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782709.859874:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922358272:0@lo:400: 00000100:00100000:3.0:1787782709.860140:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922358400 00000100:00100000:3.0:1787782709.860146:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922358400 00000100:00100000:3.0:1787782709.860180:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787782709.860187:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922358400:12345-0@lo:400: 00000100:00100000:3.0:1787782709.860232:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922358400:12345-0@lo:400: Request processed in 46us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782709.860238:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787782709.860257:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787782709.860261:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787782709.860279:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f3d7480 x1874625922358400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782709.860633:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922358400:0@lo:400: 00000100:00100000:2.0:1787782709.861111:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922358016 00000100:00100000:2.0:1787782709.861117:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922358016 00000100:00100000:2.0:1787782709.861150:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787782709.861158:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922358016:12345-0@lo:400: 00000100:00100000:2.0:1787782709.861210:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922358016:12345-0@lo:400: Request processed in 52us (3399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782709.861216:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787782709.861259:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922358016:0@lo:400: 00000100:00100000:3.0:1787782710.369372:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922358784:0@lo:13: 00000100:00100000:3.0:1787782710.369455:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782710.369544:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922358912:0@lo:13: 00000100:00100000:0.0:1787782710.369580:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782710.369626:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922358784 00000100:00100000:3.0:1787782710.369634:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922358784 00000100:00100000:3.0:1787782710.369678:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922358912 00000100:00100000:3.0:1787782710.369681:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922358912 00000100:00100000:3.0:1787782710.369702:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787782710.369711:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f389e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922358784:12345-0@lo:13: 00002000:00000024:3.0:1787782710.369759:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782710.370047:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f389e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922358784:12345-0@lo:13: Request processed in 324us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782710.370057:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787782710.370088:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787782710.370115:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922358912:12345-0@lo:13: 00002000:00000024:3.0:1787782710.370134:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782710.370295:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922358912:12345-0@lo:13: Request processed in 199us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782710.370301:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787782710.370655:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31410e6d00 x1874625922358912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782710.370674:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922358912:0@lo:13: 00010000:00080000:0.0:1787782710.370703:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31410e6580 x1874625922358784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782710.370716:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922358784:0@lo:13: 00010000:00010000:3.0:1787782710.625262:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782711.189044:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782711.195075:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904509312 00000100:00100000:0.0:1787782711.195119:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904509312 00000100:00100000:0.0:1787782711.195190:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 111 00000100:00100000:0.0:1787782711.195220:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2348:x1874625904509312:12345-192.168.202.15@tcp:250: 00010000:00080000:0.0:1787782711.195248:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ceacfe35-7480-471c-a7cd-7a05a1613220@192.168.202.15@tcp t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:0.0:1787782711.195285:0:5844:0:(genops.c:1385:class_connect()) connect: client ceacfe35-7480-471c-a7cd-7a05a1613220, cookie 0x6d98ed19b636ff2 00000100:00080000:0.0:1787782711.195448:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8c313e596000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787782711.195520:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+5:2348:x1874625904509312:12345-192.168.202.15@tcp:250: Request processed in 300us (6496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782711.195527:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 111 00000100:00100000:2.0:1787782711.202090:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782711.202785:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904509184 00000100:00100000:0.0:1787782711.202796:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904509184 00000100:00100000:0.0:1787782711.202925:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 112 00000100:00100000:0.0:1787782711.202935:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+5:5576:x1874625904509184:12345-192.168.202.15@tcp:101: 00010000:00010000:0.0:1787782711.202963:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782711.202982:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141254200/0x6d98ed19b636ff9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e51aa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782711.203016:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141254200/0x6d98ed19b636ff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e51aa expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782711.203028:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141254200/0x6d98ed19b636ff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e51aa expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782711.203047:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254200, rc 0) 00000100:00100000:0.0:1787782711.203159:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+6:5576:x1874625904509184:12345-192.168.202.15@tcp:101: Request processed in 225us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782711.203166:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 112 00000100:00100000:1.0:1787782711.217798:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782711.217949:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904509440 00000100:00100000:2.0:1787782711.217959:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904509440 00000100:00100000:2.0:1787782711.218017:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 113 00000100:00100000:2.0:1787782711.218027:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+6:5576:x1874625904509440:12345-192.168.202.15@tcp:501: 00000100:00100000:2.0:1787782711.218780:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+6:5576:x1874625904509440:12345-192.168.202.15@tcp:501: Request processed in 752us (990us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787782711.218790:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 113 00000100:00100000:3.0:1787782711.240773:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782711.242494:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904509568 00000100:00100000:2.0:1787782711.242508:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904509568 00000100:00100000:2.0:1787782711.242575:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:2.0:1787782711.242584:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+6:5576:x1874625904509568:12345-192.168.202.15@tcp:101: 00010000:00010000:2.0:1787782711.242600:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782711.242621:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31013a1a00/0x6d98ed19b637000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e51b1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782711.242653:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a1a00/0x6d98ed19b637000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e51b1 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782711.242664:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31013a1a00/0x6d98ed19b637000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e51b1 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782711.242673:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1a00, rc 0) 00000100:00100000:2.0:1787782711.242741:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+7:5576:x1874625904509568:12345-192.168.202.15@tcp:101: Request processed in 159us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782711.242749:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:3.0:1787782711.260575:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782711.260824:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904509696 00000100:00100000:0.0:1787782711.260835:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904509696 00000100:00100000:0.0:1787782711.260910:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:0.0:1787782711.260921:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+7:5576:x1874625904509696:12345-192.168.202.15@tcp:501: 00000100:00100000:0.0:1787782711.261265:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+8:5576:x1874625904509696:12345-192.168.202.15@tcp:501: Request processed in 345us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782711.261273:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:1.0:1787782711.266049:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782711.266195:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904509824 00000100:00100000:3.0:1787782711.266206:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904509824 00000100:00100000:3.0:1787782711.266271:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:3.0:1787782711.266290:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3107e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+8:5576:x1874625904509824:12345-192.168.202.15@tcp:503: 00000100:00100000:3.0:1787782711.267670:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3107e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+8:5576:x1874625904509824:12345-192.168.202.15@tcp:503: Request processed in 1375us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782711.267683:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:3.0:1787782711.280852:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782711.281654:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904509952 00000100:00100000:2.0:1787782711.281665:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904509952 00000100:00100000:2.0:1787782711.281740:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 117 00000100:00100000:2.0:1787782711.281749:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3107e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+8:5594:x1874625904509952:12345-192.168.202.15@tcp:502: 00000100:00100000:2.0:1787782711.282492:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3107e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+8:5594:x1874625904509952:12345-192.168.202.15@tcp:502: Request processed in 742us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782711.282501:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 117 00000100:00100000:2.0:1787782711.333539:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782711.333646:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904510080 00000100:00100000:3.0:1787782711.333659:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904510080 00000100:00100000:3.0:1787782711.333725:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 118 00000100:00100000:3.0:1787782711.333735:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+8:5594:x1874625904510080:12345-192.168.202.15@tcp:502: 00000100:00100000:3.0:1787782711.334040:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+8:5594:x1874625904510080:12345-192.168.202.15@tcp:502: Request processed in 305us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782711.334048:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 118 00000100:00100000:1.0:1787782711.355650:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782711.356014:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904510208 00000100:00100000:0.0:1787782711.356026:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904510208 00000100:00100000:0.0:1787782711.356138:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 119 00000100:00100000:0.0:1787782711.356154:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+8:5576:x1874625904510208:12345-192.168.202.15@tcp:101: 00010000:00010000:0.0:1787782711.356171:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782711.356228:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31013a0400/0x6d98ed19b637007 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e51db expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782711.356265:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a0400/0x6d98ed19b637007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e51db expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782711.356274:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31013a0400/0x6d98ed19b637007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e51db expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782711.356282:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0400, rc 0) 00000100:00100000:2.0:1787782711.356355:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+9:5576:x1874625904510208:12345-192.168.202.15@tcp:101: Request processed in 197us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782711.356363:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 119 00000100:00100000:0.0:1787782711.362268:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782711.362382:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904510336 00000100:00100000:2.0:1787782711.362392:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904510336 00000100:00100000:2.0:1787782711.362447:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:2.0:1787782711.362457:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+9:5576:x1874625904510336:12345-192.168.202.15@tcp:256: 20000000:01000000:2.0:1787782711.362483:0:5844:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787782711.362506:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787782711.362510:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787782711.362532:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787782711.362535:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787782711.367512:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+9:5576:x1874625904510336:12345-192.168.202.15@tcp:256: Request processed in 5044us (5242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782711.367536:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:1.0:1787782711.383240:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782711.383498:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904510464 00000100:00100000:2.0:1787782711.383509:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904510464 00000100:00100000:2.0:1787782711.383731:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:2.0:1787782711.383742:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+9:5576:x1874625904510464:12345-192.168.202.15@tcp:101: 00010000:00010000:2.0:1787782711.383761:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782711.383779:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31013a0e00/0x6d98ed19b63700e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e51e2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782711.383809:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a0e00/0x6d98ed19b63700e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e51e2 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782711.383820:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31013a0e00/0x6d98ed19b63700e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e51e2 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782711.383829:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0e00, rc 0) 00000100:00100000:2.0:1787782711.383893:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5576:x1874625904510464:12345-192.168.202.15@tcp:101: Request processed in 153us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782711.383900:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:0.0:1787782711.387075:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782711.387260:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904510592 00000100:00100000:2.0:1787782711.387271:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904510592 00000100:00100000:2.0:1787782711.387386:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00100000:2.0:1787782711.387397:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5576:x1874625904510592:12345-192.168.202.15@tcp:501: 00000100:00100000:2.0:1787782711.387727:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5576:x1874625904510592:12345-192.168.202.15@tcp:501: Request processed in 330us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782711.387736:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00100000:1.0:1787782711.390875:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782711.390985:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904510720 00000100:00100000:0.0:1787782711.390995:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904510720 00000100:00100000:0.0:1787782711.391070:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 123 00000100:00100000:0.0:1787782711.391081:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5576:x1874625904510720:12345-192.168.202.15@tcp:503: 00000100:00100000:0.0:1787782711.400143:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5576:x1874625904510720:12345-192.168.202.15@tcp:503: Request processed in 9051us (9358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782711.400160:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 123 00000100:00100000:1.0:1787782711.403832:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782711.404020:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904510848 00000100:00100000:2.0:1787782711.404030:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904510848 00000100:00100000:2.0:1787782711.413725:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 124 00000100:00100000:2.0:1787782711.413751:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5600:x1874625904510848:12345-192.168.202.15@tcp:502: 00000100:00100000:2.0:1787782711.414318:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5600:x1874625904510848:12345-192.168.202.15@tcp:502: Request processed in 577us (10492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782711.414328:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 124 00000100:00100000:3.0:1787782711.417396:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782711.417964:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904510976 00000100:00100000:0.0:1787782711.417976:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904510976 00000100:00100000:0.0:1787782711.418040:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 125 00000100:00100000:0.0:1787782711.418049:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5600:x1874625904510976:12345-192.168.202.15@tcp:502: 00000100:00100000:1.0:1787782711.418834:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5600:x1874625904510976:12345-192.168.202.15@tcp:502: Request processed in 783us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782711.418843:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 125 00000100:00100000:1.0:1787782711.424843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782711.424963:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904511104 00000100:00100000:0.0:1787782711.424972:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904511104 00000100:00100000:0.0:1787782711.425025:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:0.0:1787782711.425045:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2348:x1874625904511104:12345-192.168.202.15@tcp:38: 00010000:00080000:0.0:1787782711.425080:0:6719:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:0.0:1787782711.425167:0:6719:0:(genops.c:1385:class_connect()) connect: client 6e4b0e72-6952-496d-b228-ab2778cd786f, cookie 0x6d98ed19b637015 00000004:00100000:0.0:1787782711.425197:0:6719:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787782711.425203:0:6719:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787782711.450322:0:6719:0:(import.c:65:import_set_state_nolock()) ffff8c31342db000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782711.450424:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2348:x1874625904511104:12345-192.168.202.15@tcp:38: Request processed in 25377us (25591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782711.450435:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00010000:00010000:0.0:1787782711.649667:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782712.455861:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782712.456703:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904511232 00000100:00100000:0.0:1787782712.456718:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904511232 00000100:00080000:3.0:1787782712.456901:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782712.457418:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:0.0:1787782712.457434:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:0:x1874625904511232:12345-192.168.202.15@tcp:41: 00000004:00000024:0.0:1787782712.457497:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787782712.457613:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:0:x1874625904511232:12345-192.168.202.15@tcp:41: Request processed in 184us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782712.457621:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:3.0:1787782712.462884:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782712.464659:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904511360 00000100:00100000:1.0:1787782712.464678:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904511360 00000100:00100000:1.0:1787782712.464767:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:1.0:1787782712.464779:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f38b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:5576:x1874625904511360:12345-192.168.202.15@tcp:41: 00000004:00000024:1.0:1787782712.464825:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787782712.464919:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f38b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:5576:x1874625904511360:12345-192.168.202.15@tcp:41: Request processed in 141us (2270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782712.464928:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:2.0:1787782712.474937:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782712.475078:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904511488 00000100:00100000:1.0:1787782712.475140:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904511488 00000100:00100000:1.0:1787782712.475248:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:1.0:1787782712.475261:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:5576:x1874625904511488:12345-192.168.202.15@tcp:40: 00000100:00100000:1.0:1787782712.476294:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:5576:x1874625904511488:12345-192.168.202.15@tcp:40: Request processed in 1029us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782712.476307:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:2.0:1787782712.487051:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782712.487539:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782712.487587:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782712.487682:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904511872 00000100:00100000:1.0:1787782712.487697:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904511872 00000100:00100000:1.0:1787782712.487784:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:1.0:1787782712.487796:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:5576:x1874625904511872:12345-192.168.202.15@tcp:33: 00000100:00100000:2.0:1787782712.499436:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782712.499502:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904512000 00000100:00100000:2.0:1787782712.499514:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904512000 00000100:00100000:2.0:1787782712.499588:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 126 00000100:00100000:2.0:1787782712.499600:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2352:x1874625904512000:12345-192.168.202.15@tcp:400: 00000100:00100000:2.0:1787782712.499711:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2352:x1874625904512000:12345-192.168.202.15@tcp:400: Request processed in 113us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782712.499719:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 126 00000100:00100000:3.0:1787782712.505833:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904511616 00000100:00100000:3.0:1787782712.505855:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904511616 00000100:00100000:3.0:1787782712.505933:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904511744 00000100:00100000:3.0:1787782712.505936:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904511744 00000100:00100000:3.0:1787782712.505981:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:3.0:1787782712.505990:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1874625904511616:12345-192.168.202.15@tcp:8: 00010000:00080000:3.0:1787782712.506036:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:3.0:1787782712.506077:0:6696:0:(genops.c:1385:class_connect()) connect: client 6e4b0e72-6952-496d-b228-ab2778cd786f, cookie 0x6d98ed19b63701c 00002000:00100000:3.0:1787782712.506114:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e4b0e72-6952-496d-b228-ab2778cd786f/ffff8c3133fc7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113937 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787782712.506146:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1787782712.506397:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:2.0:1787782712.506405:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3112d79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1874625904511744:12345-192.168.202.15@tcp:8: 00010000:00080000:2.0:1787782712.506446:0:6967:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:2.0:1787782712.506472:0:6967:0:(genops.c:1385:class_connect()) connect: client 6e4b0e72-6952-496d-b228-ab2778cd786f, cookie 0x6d98ed19b637023 00002000:00100000:2.0:1787782712.506478:0:6967:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e4b0e72-6952-496d-b228-ab2778cd786f/ffff8c31342dc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113937 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787782712.506496:0:6967:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787782712.506967:0:6967:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787782712.507018:0:6967:0:(import.c:65:import_set_state_nolock()) ffff8c31342dd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782712.509571:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3112d79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2348:x1874625904511744:12345-192.168.202.15@tcp:8: Request processed in 3143us (21970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782712.509591:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00002000:00080000:3.0:1787782712.511022:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787782712.511085:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8c3133fc0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787782712.511927:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2348:x1874625904511616:12345-192.168.202.15@tcp:8: Request processed in 5927us (24879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782712.511943:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000004:00080000:2.0:1787782712.522647:0:5854:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 34234us 00000004:00200000:2.0:1787782712.550808:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787782712.551062:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:5576:x1874625904511872:12345-192.168.202.15@tcp:33: Request processed in 63260us (63515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782712.551083:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00010000:00010000:1.0:1787782712.676398:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782712.811137:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782712.812720:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904512128 00000100:00100000:2.0:1787782712.812740:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904512128 00000100:00100000:2.0:1787782712.812837:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:2.0:1787782712.812850:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:5617:x1874625904512128:12345-192.168.202.15@tcp:101: 00010000:00010000:2.0:1787782712.812881:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782712.814295:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295e00/0x6d98ed19b63702a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e520c expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782712.814515:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b637031 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782712.814531:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b637031 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782712.814563:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b637031 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782712.815044:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787782712.815049:0:6719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782712.815168:0:6719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b637031 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782712.815202:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295e00/0x6d98ed19b63702a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e520c expref: 8 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782712.815220:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b637031 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e520c expref: 7 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782712.815228:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3108738600) 00010000:00010000:2.0:1787782712.815232:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787782712.815235:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312f295600, rc 0) 00000100:00100000:2.0:1787782712.815773:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f38b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+7:5617:x1874625904512128:12345-192.168.202.15@tcp:101: Request processed in 2924us (4676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782712.815845:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00010000:00010000:3.0:1787782713.697369:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782714.721661:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782714.783177:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782714.783376:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904512256 00000100:00100000:1.0:1787782714.783396:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904512256 00000100:00100000:1.0:1787782714.783517:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:1.0:1787782714.783531:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+7:5669:x1874625904512256:12345-192.168.202.15@tcp:41: 00000004:00000024:1.0:1787782714.783596:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787782714.783710:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+7:5669:x1874625904512256:12345-192.168.202.15@tcp:41: Request processed in 182us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782714.783719:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00080000:3.0:1787782714.783779:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782714.790707:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782714.793225:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904512384 00000100:00100000:1.0:1787782714.793381:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904512384 00000100:00080000:3.0:1787782714.793589:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782714.793716:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:1.0:1787782714.793728:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e4b0e72-6952-496d-b228-ab2778cd786f+6:5669:x1874625904512384:12345-192.168.202.15@tcp:13: 00002000:00000024:1.0:1787782714.793786:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782714.793887:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e4b0e72-6952-496d-b228-ab2778cd786f+6:5669:x1874625904512384:12345-192.168.202.15@tcp:13: Request processed in 161us (3195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782714.793895:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:2.0:1787782714.797250:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782714.797352:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904512512 00000100:00100000:3.0:1787782714.797364:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904512512 00000100:00100000:3.0:1787782714.797439:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:3.0:1787782714.797465:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e4b0e72-6952-496d-b228-ab2778cd786f+6:5669:x1874625904512512:12345-192.168.202.15@tcp:13: 00002000:00000024:3.0:1787782714.797530:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782714.797632:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6e4b0e72-6952-496d-b228-ab2778cd786f+6:5669:x1874625904512512:12345-192.168.202.15@tcp:13: Request processed in 171us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782714.797640:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00080000:0.0:1787782714.798714:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787782714.977479:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922359296:0@lo:400: 00000100:00100000:0.0:1787782714.977578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782714.977672:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782714.977678:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922359424:0@lo:400: 00000100:00100000:0.0:1787782714.977707:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782714.977755:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922359296 00000100:00100000:0.0:1787782714.977764:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922359296 00000100:00100000:0.0:1787782714.977835:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787782714.977845:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922359296:12345-0@lo:400: 00000100:00100000:0.0:1787782714.977929:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922359296:12345-0@lo:400: Request processed in 85us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782714.977937:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787782714.977963:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782714.978001:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922359296:0@lo:400: 00000100:00100000:1.0:1787782714.978134:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922359040:0@lo:400: 00000100:00100000:1.0:1787782714.978171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782714.978207:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922359552:0@lo:400: 00000100:00100000:1.0:1787782714.978231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782714.978253:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787782714.978259:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625922359168:0@lo:400: 00000100:00100000:1.0:1787782714.978282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782714.978300:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922359680:0@lo:400: 00000100:00100000:1.0:1787782714.978337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782714.978365:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922359552 00000100:00100000:1.0:1787782714.978369:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922359552 00000100:00100000:1.0:1787782714.978397:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922359168 00000100:00100000:1.0:1787782714.978400:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922359168 00000100:00100000:1.0:1787782714.978412:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787782714.978417:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922359552:12345-0@lo:400: 00000100:00100000:1.0:1787782714.978452:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922359552:12345-0@lo:400: Request processed in 34us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782714.978458:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787782714.978470:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787782714.978474:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625922359168:12345-0@lo:400: 00000100:00100000:1.0:1787782714.978499:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625922359168:12345-0@lo:400: Request processed in 24us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782714.978505:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787782714.978523:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782714.978543:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625922359168:0@lo:400: 00000100:00100000:1.0:1787782714.978554:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922359552:0@lo:400: 00000100:00100000:2.0:1787782714.978759:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922359424 00000100:00100000:2.0:1787782714.978764:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922359424 00000100:00100000:2.0:1787782714.978800:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922359680 00000100:00100000:2.0:1787782714.978803:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922359680 00000100:00100000:2.0:1787782714.978821:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787782714.978828:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922359424:12345-0@lo:400: 00000100:00100000:2.0:1787782714.978868:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922359424:12345-0@lo:400: Request processed in 42us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782714.978881:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787782714.978895:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787782714.978900:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922359680:12345-0@lo:400: 00000100:00100000:2.0:1787782714.978928:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922359680:12345-0@lo:400: Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782714.978933:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787782714.978954:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787782714.978956:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787782714.978975:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f3d6d00 x1874625922359424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782714.978987:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922359424:0@lo:400: 00000100:00100000:0.0:1787782714.979067:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922359040 00000100:00100000:0.0:1787782714.979072:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922359040 00000100:00100000:0.0:1787782714.979125:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787782714.979133:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3304:x1874625922359040:12345-0@lo:400: 00000100:00100000:0.0:1787782714.979164:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3304:x1874625922359040:12345-0@lo:400: Request processed in 34us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782714.979182:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:1.0:1787782714.979339:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f3d7480 x1874625922359680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782714.979349:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922359680:0@lo:400: 00000100:00100000:1.0:1787782714.979358:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922359040:0@lo:400: 00000100:00100000:0.0:1787782715.489502:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787782715.489536:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119ef5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922359808:0@lo:13: 00000100:00100000:0.0:1787782715.489627:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782715.489927:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922359808 00000100:00100000:3.0:1787782715.489938:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922359808 00000100:00100000:2.0:1787782715.491164:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787782715.491575:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787782715.491588:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922359808:12345-0@lo:13: 00002000:00000024:3.0:1787782715.491621:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782715.491708:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922359808:12345-0@lo:13: Request processed in 122us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782715.491716:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787782715.491765:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3119ef5e00 x1874625922359808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782715.491787:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119ef5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922359808:0@lo:13: 00000100:00100000:2.0:1787782715.491872:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922359936:0@lo:13: 00000100:00100000:2.0:1787782715.491917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782715.492459:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922359936 00000100:00100000:3.0:1787782715.492468:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922359936 00000100:00100000:3.0:1787782715.492509:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787782715.492518:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922359936:12345-0@lo:13: 00002000:00000024:3.0:1787782715.492535:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782715.492590:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922359936:12345-0@lo:13: Request processed in 73us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782715.492596:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787782715.492756:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31410e4f00 x1874625922359936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782715.493156:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922359936:0@lo:13: 00000001:00100000:0.0:1787782715.574658:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e4b0e72-6952-496d-b228-ab2778cd786f 00010000:00010000:1.0:1787782715.746494:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787782716.615387:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e4b0e72-6952-496d-b228-ab2778cd786f 00010000:00010000:3.0:1787782716.769245:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787782717.275308:0:8300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1787782717.658887:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e4b0e72-6952-496d-b228-ab2778cd786f 00010000:00010000:0.0:1787782717.812408:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782717.966002:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782717.966400:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904512768 00000100:00100000:1.0:1787782717.966414:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904512768 00000100:00100000:1.0:1787782717.966780:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:1.0:1787782717.966794:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f388b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904512768:12345-192.168.202.15@tcp:400: 00000100:00100000:1.0:1787782717.966890:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f388b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904512768:12345-192.168.202.15@tcp:400: Request processed in 100us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782717.966897:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00080000:3.0:1787782717.971780:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782717.972134:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782717.972194:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782717.972236:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782717.972339:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904513024 00000100:00100000:0.0:1787782717.972353:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904513024 00000100:00100000:0.0:1787782717.972433:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904512896 00000100:00100000:0.0:1787782717.972436:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904512896 00000100:00100000:0.0:1787782717.972466:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:0.0:1787782717.972477:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2349:x1874625904513024:12345-192.168.202.15@tcp:400: 00000100:00100000:0.0:1787782717.972603:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2349:x1874625904513024:12345-192.168.202.15@tcp:400: Request processed in 127us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782717.972612:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:0.0:1787782717.972642:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:0.0:1787782717.972649:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2350:x1874625904512896:12345-192.168.202.15@tcp:400: 00000100:00100000:0.0:1787782717.972678:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2350:x1874625904512896:12345-192.168.202.15@tcp:400: Request processed in 29us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782717.972684:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:3.0:1787782717.973000:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904512640 00000100:00100000:3.0:1787782717.973005:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904512640 00000100:00100000:3.0:1787782717.973050:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 128 00000100:00100000:3.0:1787782717.973058:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31091ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2350:x1874625904512640:12345-192.168.202.15@tcp:400: 00000100:00100000:3.0:1787782717.973091:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31091ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2350:x1874625904512640:12345-192.168.202.15@tcp:400: Request processed in 35us (897us total) trans 0 rc 0/0 00000100:00080000:2.0:1787782717.973180:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787782717.973184:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787782717.973430:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 128 00010000:00010000:1.0:1787782718.817702:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782719.850335:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782720.099208:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922360320:0@lo:400: 00000100:00100000:1.0:1787782720.099292:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782720.099351:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782720.099359:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922360448:0@lo:400: 00000100:00100000:1.0:1787782720.099411:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782720.099456:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922360320 00000100:00100000:1.0:1787782720.099463:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922360320 00000100:00100000:1.0:1787782720.099532:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787782720.099542:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922360320:12345-0@lo:400: 00000100:00100000:1.0:1787782720.099606:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922360320:12345-0@lo:400: Request processed in 66us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782720.099614:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787782720.099647:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922360448 00000100:00100000:1.0:1787782720.099651:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922360448 00000100:00100000:3.0:1787782720.099683:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922360320:0@lo:400: 00000100:00100000:1.0:1787782720.099690:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787782720.099701:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f134b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922360448:12345-0@lo:400: 00000100:00100000:1.0:1787782720.099748:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f134b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922360448:12345-0@lo:400: Request processed in 50us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782720.099755:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787782720.099809:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3119fd3840 x1874625922360448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782720.099821:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922360448:0@lo:400: 00000100:00100000:0.0:1787782720.100020:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922360064:0@lo:400: 00000100:00100000:0.0:1787782720.100055:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782720.100088:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922360576:0@lo:400: 00000100:00100000:0.0:1787782720.100128:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782720.100143:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922360064 00000100:00100000:3.0:1787782720.100149:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922360064 00000100:00100000:0.0:1787782720.100152:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787782720.100160:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625922360192:0@lo:400: 00000100:00100000:3.0:1787782720.100188:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787782720.100188:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782720.100200:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31091b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3304:x1874625922360064:12345-0@lo:400: 00000100:00100000:0.0:1787782720.100219:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922360704:0@lo:400: 00000100:00100000:3.0:1787782720.100249:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31091b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3304:x1874625922360064:12345-0@lo:400: Request processed in 50us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782720.100255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782720.100274:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787782720.100303:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922360064:0@lo:400: 00000100:00080000:3.0:1787782720.101163:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787782720.101170:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782720.101327:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922360576 00000100:00100000:1.0:1787782720.101334:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922360576 00000100:00100000:1.0:1787782720.101929:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922360192 00000100:00100000:1.0:1787782720.101934:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922360192 00000100:00080000:3.0:1787782720.102544:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782720.109677:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787782720.109700:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922360576:12345-0@lo:400: 00000100:00100000:0.0:1787782720.109938:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922360576:12345-0@lo:400: Request processed in 247us (9807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782720.109946:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787782720.109989:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787782720.109996:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625922360192:12345-0@lo:400: 00000100:00100000:0.0:1787782720.110029:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625922360192:12345-0@lo:400: Request processed in 34us (9844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782720.110035:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787782720.110177:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625922360192:0@lo:400: 00000100:00100000:0.0:1787782720.110193:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922360576:0@lo:400: 00000100:00100000:0.0:1787782720.117242:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922360704 00000100:00100000:0.0:1787782720.117257:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922360704 00000100:00100000:0.0:1787782720.117340:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787782720.117350:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922360704:12345-0@lo:400: 00000100:00100000:0.0:1787782720.117453:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922360704:12345-0@lo:400: Request processed in 104us (17200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782720.117460:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787782720.117505:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3119fd2d00 x1874625922360704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782720.117520:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922360704:0@lo:400: 00000100:00080000:3.0:1787782720.118453:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787782720.609996:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787782720.610025:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922360832:0@lo:13: 00000100:00100000:1.0:1787782720.610134:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782720.610323:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922360832 00000100:00100000:2.0:1787782720.610330:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922360832 00000100:00100000:2.0:1787782720.610851:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787782720.610864:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f134780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922360832:12345-0@lo:13: 00002000:00000024:2.0:1787782720.610901:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787782720.610963:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f134780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922360832:12345-0@lo:13: Request processed in 102us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782720.610982:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787782720.611055:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31070fda40 x1874625922360832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782720.611074:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922360832:0@lo:13: 00000100:00100000:1.0:1787782720.614574:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782720.614607:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f136580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922360960:0@lo:13: 00000100:00100000:1.0:1787782720.614682:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782720.615154:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922360960 00000100:00100000:3.0:1787782720.615164:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922360960 00000100:00100000:3.0:1787782720.615207:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787782720.615217:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f136d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922360960:12345-0@lo:13: 00002000:00000024:3.0:1787782720.615303:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782720.615362:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f136d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922360960:12345-0@lo:13: Request processed in 147us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782720.615369:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787782720.615915:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f136580 x1874625922360960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782720.615938:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f136580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922360960:0@lo:13: 00010000:00010000:0.0:1787782720.865577:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787782721.378208:0:8449:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef3b3b680 20000000:00000080:1.0:1787782721.378223:0:8449:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c312efe8c00 uarg=0000000000000000 20000000:01000000:1.0:1787782721.378443:0:8449:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787782721.378446:0:8449:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787782721.378449:0:8449:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787782721.378455:0:8449:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787782721.378460:0:8449:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787782721.378474:0:8449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787782721.378477:0:8449:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787782721.378852:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787782721.378855:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787782721.379809:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1787782721.380502:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1787782721.380567:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1787782721.380600:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1787782721.380613:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787782721.380615:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787782721.381259:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787782721.381591:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787782721.381637:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787782721.381674:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1787782721.381686:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787782721.381688:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787782721.383007:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787782721.383542:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787782721.383589:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787782721.383636:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1787782721.383647:0:8449:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787782721.383649:0:8449:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787782721.384365:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787782721.384667:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787782721.384717:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787782721.384752:0:8449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:1.0:1787782721.384767:0:8449:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787782721.384786:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c31421fc600/0x6d98ed19b637038 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.384804:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3100030200/0x6d98ed19b636f35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636f2e expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.384812:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31421fd400/0x6d98ed19b636f5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636f58 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.384819:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31421fd000/0x6d98ed19b636f89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636f82 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.384836:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636f90 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.384843:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636fa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636f9e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.384850:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3100031a00/0x6d98ed19b636fc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636fba expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.384858:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31013a1200/0x6d98ed19b636feb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636fe4 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.384868:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3141254200/0x6d98ed19b636ff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e51aa expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.384875:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31013a1a00/0x6d98ed19b637000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e51b1 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.384883:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c31421fc600/0x6d98ed19b637038 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.384919:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31013a1a00/0x6d98ed19b637000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51b1 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.384933:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c31013a1a00/0x6d98ed19b637000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51b1 expref: 9 pid: 5844 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.384948:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1343c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922361088:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782721.385086:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3141254200/0x6d98ed19b636ff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51aa expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.385131:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c3141254200/0x6d98ed19b636ff9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51aa expref: 9 pid: 5846 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.385141:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1352c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922361216:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782721.385177:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31013a1200/0x6d98ed19b636feb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636fe4 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.385185:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c31013a1200/0x6d98ed19b636feb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636fe4 expref: 18 pid: 5844 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.385194:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f135680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922361344:0@lo:104: 00000100:00100000:1.0:1787782721.385228:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787782721.385267:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3100031a00/0x6d98ed19b636fc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636fba expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.385276:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c3100031a00/0x6d98ed19b636fc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636fba expref: 18 pid: 5845 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.385284:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f137840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922361472:0@lo:104: 00000100:00100000:1.0:1787782721.385307:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787782721.385332:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636fa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636f9e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.385340:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636fa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636f9e expref: 18 pid: 5846 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.385349:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f136940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922361600:0@lo:104: 00010000:00010000:1.0:1787782721.385373:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636f90 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.385388:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636f90 expref: 18 pid: 5845 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.385397:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922361728:0@lo:104: 00010000:00010000:1.0:1787782721.385423:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31421fd000/0x6d98ed19b636f89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636f82 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.385431:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c31421fd000/0x6d98ed19b636f89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636f82 expref: 18 pid: 5845 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.385439:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f135a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922361856:0@lo:104: 00010000:00010000:1.0:1787782721.385464:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31421fd400/0x6d98ed19b636f5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636f58 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.385471:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c31421fd400/0x6d98ed19b636f5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636f58 expref: 18 pid: 5846 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.385480:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f134f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922361984:0@lo:104: 00010000:00010000:1.0:1787782721.385502:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3100030200/0x6d98ed19b636f35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636f2e expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.385510:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c3100030200/0x6d98ed19b636f35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636f2e expref: 18 pid: 5844 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.385517:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f135e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922362112:0@lo:104: 00000100:00100000:1.0:1787782721.385535:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c313455d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787782721.385612:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787782721.385632:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782721.385658:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782721.385671:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782721.385682:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782721.385691:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782721.385700:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922361344 00000100:00100000:0.0:1787782721.385705:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922361344 00000100:00100000:0.0:1787782721.385743:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922361472 00000100:00100000:0.0:1787782721.385752:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922361472 00000100:00100000:0.0:1787782721.385766:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922361600 00000100:00100000:0.0:1787782721.385769:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922361600 00000100:00100000:0.0:1787782721.385779:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922361728 00000100:00100000:0.0:1787782721.385781:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922361728 00000100:00100000:0.0:1787782721.385790:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922361856 00000100:00100000:0.0:1787782721.385791:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922361856 00000100:00100000:0.0:1787782721.385799:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922361984 00000100:00100000:0.0:1787782721.385801:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922361984 00000100:00100000:0.0:1787782721.385809:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922362112 00000100:00100000:0.0:1787782721.385811:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922362112 00000100:00100000:0.0:1787782721.385823:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787782721.385830:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f137c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+9:8449:x1874625922361344:12345-0@lo:104: 00010000:00010000:0.0:1787782721.385841:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636fe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636feb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.385899:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787782721.385904:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f137c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+9:8449:x1874625922361344:12345-0@lo:104: Request processed in 75us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782721.385911:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787782721.385925:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787782721.385930:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+8:8449:x1874625922361472:12345-0@lo:104: 00010000:00010000:0.0:1787782721.385937:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636fba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636fc1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.385964:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787782721.385969:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+8:8449:x1874625922361472:12345-0@lo:104: Request processed in 39us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782721.385974:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787782721.386003:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787782721.386014:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+7:8449:x1874625922361600:12345-0@lo:104: 00010000:00010000:0.0:1787782721.386022:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c3100030600/0x6d98ed19b636f9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636fa5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386048:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787782721.386052:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+7:8449:x1874625922361600:12345-0@lo:104: Request processed in 40us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782721.386058:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787782721.386068:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787782721.386073:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+6:8449:x1874625922361728:12345-0@lo:104: 00010000:00010000:0.0:1787782721.386079:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636f90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636f97 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386131:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787782721.386136:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+6:8449:x1874625922361728:12345-0@lo:104: Request processed in 64us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782721.386142:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787782721.386155:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787782721.386160:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+5:8449:x1874625922361856:12345-0@lo:104: 00010000:00010000:0.0:1787782721.386167:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c3100031e00/0x6d98ed19b636f82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636f89 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386189:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787782721.386193:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+5:8449:x1874625922361856:12345-0@lo:104: Request processed in 34us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782721.386199:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787782721.386209:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787782721.386214:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+4:8449:x1874625922361984:12345-0@lo:104: 00010000:00010000:0.0:1787782721.386227:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b636f58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636f5f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386266:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1787782721.386271:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+4:8449:x1874625922361984:12345-0@lo:104: Request processed in 57us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782721.386277:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787782721.386290:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787782721.386297:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+3:8449:x1874625922362112:12345-0@lo:104: 00010000:00010000:0.0:1787782721.386304:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31013a1600/0x6d98ed19b636f2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636f35 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386331:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1787782721.386335:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+3:8449:x1874625922362112:12345-0@lo:104: Request processed in 39us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782721.386341:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787782721.386360:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787782721.386367:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636fe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636feb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386375:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1e00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:0.0:1787782721.386379:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636fe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636feb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386389:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636fe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636feb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782721.386397:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636fe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636feb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782721.386410:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787782721.386436:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636fe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636feb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386444:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782721.386460:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636fe4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636feb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386467:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31013a1e00/0x6d98ed19b636fe4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636feb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386481:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787782721.386485:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636fba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636fc1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386490:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:0.0:1787782721.386493:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636fba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636fc1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386499:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636fba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636fc1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782721.386506:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636fba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636fc1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782721.386510:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787782721.386522:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636fba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636fc1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386527:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782721.386538:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636fba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636fc1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386544:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b636fba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636fc1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386552:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787782721.386555:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3100030600/0x6d98ed19b636f9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636fa5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386560:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3100030600 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:0.0:1787782721.386563:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3100030600/0x6d98ed19b636f9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636fa5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386569:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3100030600/0x6d98ed19b636f9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636fa5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782721.386574:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3100030600/0x6d98ed19b636f9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636fa5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782721.386579:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787782721.386591:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3100030600/0x6d98ed19b636f9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636fa5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386597:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782721.386612:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3100030600/0x6d98ed19b636f9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636fa5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386618:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3100030600/0x6d98ed19b636f9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636fa5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386629:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787782721.386639:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636f90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636f97 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386646:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3100031200 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:0.0:1787782721.386649:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636f90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636f97 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386654:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636f90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636f97 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782721.386659:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636f90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636f97 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782721.386664:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787782721.386676:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636f90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f97 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386681:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782721.386685:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636f90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f97 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386691:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3100031200/0x6d98ed19b636f90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f97 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386700:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787782721.386702:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3100031e00/0x6d98ed19b636f82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636f89 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386708:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3100031e00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:0.0:1787782721.386710:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3100031e00/0x6d98ed19b636f82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636f89 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386727:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3100031e00/0x6d98ed19b636f82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636f89 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782721.386733:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3100031e00/0x6d98ed19b636f82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636f89 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782721.386738:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787782721.386751:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3100031e00/0x6d98ed19b636f82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f89 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386756:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782721.386760:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3100031e00/0x6d98ed19b636f82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f89 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386767:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3100031e00/0x6d98ed19b636f82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f89 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386775:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787782721.386779:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b636f58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636f5f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386784:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0800 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:0.0:1787782721.386787:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b636f58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636f5f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386794:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b636f58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636f5f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782721.386800:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b636f58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636f5f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782721.386811:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787782721.386824:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b636f58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f5f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386830:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782721.386834:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b636f58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f5f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386841:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b636f58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f5f expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386851:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782721.386854:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31013a1600/0x6d98ed19b636f2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636f35 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386860:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1600 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:0.0:1787782721.386863:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a1600/0x6d98ed19b636f2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636f35 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386870:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31013a1600/0x6d98ed19b636f2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636f35 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782721.386877:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a1600/0x6d98ed19b636f2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636f35 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782721.386882:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787782721.386893:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31013a1600/0x6d98ed19b636f2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f35 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386899:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782721.386910:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31013a1600/0x6d98ed19b636f2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f35 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386917:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31013a1600/0x6d98ed19b636f2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f35 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.386931:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782721.386934:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782721.386935:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782721.386943:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782721.386949:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782721.386961:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922362240:0@lo:103: 00000100:00100000:0.0:1787782721.386996:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782721.387021:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922362752:0@lo:103: 00000100:00100000:0.0:1787782721.387041:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782721.387059:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787782721.387064:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922362368:0@lo:103: 00000100:00100000:0.0:1787782721.387084:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782721.387121:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922362880:0@lo:103: 00000100:00100000:0.0:1787782721.387141:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782721.387166:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922362496:0@lo:103: 00000100:00100000:0.0:1787782721.387186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782721.387196:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922363008:0@lo:103: 00000100:00100000:0.0:1787782721.387213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782721.387223:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782721.387227:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922362624:0@lo:103: 00000100:00100000:0.0:1787782721.387248:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782721.387287:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922362240 00000100:00100000:0.0:1787782721.387292:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922362240 00010000:00010000:0.0:1787782721.387312:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31013a1200/0x6d98ed19b636feb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636fe4 expref: 19 pid: 5844 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782721.387327:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922362752 00000100:00100000:0.0:1787782721.387329:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922362752 00010000:00010000:0.0:1787782721.387337:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31421fd000/0x6d98ed19b636f89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636f82 expref: 20 pid: 5845 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782721.387346:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922362368 00000100:00100000:0.0:1787782721.387348:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922362368 00010000:00010000:0.0:1787782721.387355:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3100031a00/0x6d98ed19b636fc1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636fba expref: 21 pid: 5845 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782721.387363:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922362880 00000100:00100000:0.0:1787782721.387365:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922362880 00010000:00010000:0.0:1787782721.387373:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31421fd400/0x6d98ed19b636f5f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636f58 expref: 22 pid: 5846 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782721.387381:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922362496 00000100:00100000:0.0:1787782721.387383:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922362496 00010000:00010000:0.0:1787782721.387390:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636fa5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636f9e expref: 23 pid: 5846 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782721.387398:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922363008 00000100:00100000:0.0:1787782721.387400:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922363008 00010000:00010000:0.0:1787782721.387408:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3100030200/0x6d98ed19b636f35 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636f2e expref: 24 pid: 5844 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782721.387416:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922362624 00000100:00100000:0.0:1787782721.387418:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922362624 00010000:00010000:0.0:1787782721.387425:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636f90 expref: 25 pid: 5845 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782721.387448:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787782721.387455:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+25:3304:x1874625922362240:12345-0@lo:103: 00010000:00010000:0.0:1787782721.387465:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782721.387471:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31013a1200/0x6d98ed19b636feb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636fe4 expref: 25 pid: 5844 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.387480:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31013a1200/0x6d98ed19b636feb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636fe4 expref: 25 pid: 5844 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.387496:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782721.387524:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+25:3304:x1874625922362240:12345-0@lo:103: Request processed in 70us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782721.387531:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787782721.387544:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787782721.387550:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+24:3304:x1874625922362752:12345-0@lo:103: 00010000:00010000:0.0:1787782721.387557:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782721.387562:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31421fd000/0x6d98ed19b636f89 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636f82 expref: 24 pid: 5845 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.387570:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31421fd000/0x6d98ed19b636f89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636f82 expref: 24 pid: 5845 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.387580:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782721.387602:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+24:3304:x1874625922362752:12345-0@lo:103: Request processed in 52us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782721.387608:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787782721.387619:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787782721.387632:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+23:3304:x1874625922362368:12345-0@lo:103: 00010000:00010000:0.0:1787782721.387640:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782721.387645:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3100031a00/0x6d98ed19b636fc1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636fba expref: 23 pid: 5845 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.387654:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3100031a00/0x6d98ed19b636fc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636fba expref: 23 pid: 5845 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.387663:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782721.387685:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+23:3304:x1874625922362368:12345-0@lo:103: Request processed in 54us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782721.387692:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787782721.387705:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787782721.387711:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+22:3304:x1874625922362880:12345-0@lo:103: 00010000:00010000:0.0:1787782721.387718:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782721.387722:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31421fd400/0x6d98ed19b636f5f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636f58 expref: 22 pid: 5846 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.387730:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31421fd400/0x6d98ed19b636f5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636f58 expref: 22 pid: 5846 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.387739:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782721.387759:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+22:3304:x1874625922362880:12345-0@lo:103: Request processed in 49us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782721.387764:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787782721.387775:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787782721.387781:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+21:3306:x1874625922362496:12345-0@lo:103: 00010000:00010000:0.0:1787782721.387804:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782721.387814:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636fa5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636f9e expref: 21 pid: 5846 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.387823:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636fa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636f9e expref: 21 pid: 5846 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.387832:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782721.387855:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+21:3306:x1874625922362496:12345-0@lo:103: Request processed in 75us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782721.387861:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787782721.387872:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787782721.387877:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+20:3306:x1874625922363008:12345-0@lo:103: 00010000:00010000:0.0:1787782721.387883:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782721.387888:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3100030200/0x6d98ed19b636f35 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636f2e expref: 20 pid: 5844 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.387896:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3100030200/0x6d98ed19b636f35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636f2e expref: 20 pid: 5844 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.387905:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782721.387920:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+20:3306:x1874625922363008:12345-0@lo:103: Request processed in 44us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782721.387926:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787782721.387934:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787782721.387939:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3118514850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922362624:12345-0@lo:103: 00010000:00010000:0.0:1787782721.387946:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782721.387950:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636f90 expref: 19 pid: 5845 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.387967:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636f90 expref: 19 pid: 5845 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.387976:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782721.387992:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3118514850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922362624:12345-0@lo:103: Request processed in 53us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782721.387998:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787782721.388045:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922362624:0@lo:103: 00000100:00100000:0.0:1787782721.388052:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922362496:0@lo:103: 00000100:00100000:0.0:1787782721.388058:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922363008:0@lo:103: 00000100:00100000:0.0:1787782721.388086:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922362368:0@lo:103: 00000100:00100000:0.0:1787782721.388112:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922362880:0@lo:103: 00000100:00100000:0.0:1787782721.388121:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922362240:0@lo:103: 00000100:00100000:0.0:1787782721.388128:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922362752:0@lo:103: 00010000:00010000:1.0:1787782721.388395:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31013a1200/0x6d98ed19b636feb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636fe4 expref: 18 pid: 5844 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.388421:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f135680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922361344:0@lo:104: 00010000:00010000:1.0:1787782721.388435:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3100031a00/0x6d98ed19b636fc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636fba expref: 17 pid: 5845 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.388444:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f137840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922361472:0@lo:104: 00010000:00010000:1.0:1787782721.388454:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b636fa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636f9e expref: 16 pid: 5846 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.388462:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f136940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922361600:0@lo:104: 00010000:00010000:1.0:1787782721.388471:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b636f97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636f90 expref: 15 pid: 5845 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.388478:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922361728:0@lo:104: 00010000:00010000:1.0:1787782721.388487:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31421fd000/0x6d98ed19b636f89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636f82 expref: 14 pid: 5845 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.388494:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f135a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922361856:0@lo:104: 00010000:00010000:1.0:1787782721.388502:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31421fd400/0x6d98ed19b636f5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636f58 expref: 13 pid: 5846 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.388509:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f134f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922361984:0@lo:104: 00010000:00010000:1.0:1787782721.388517:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3100030200/0x6d98ed19b636f35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636f2e expref: 12 pid: 5844 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.388525:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f135e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922362112:0@lo:104: 00000100:00100000:2.0:1787782721.393550:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782721.393580:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782721.393606:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904513152 00000100:00100000:2.0:1787782721.393614:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904513152 00010000:00010000:2.0:1787782721.393648:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31013a1a00/0x6d98ed19b637000 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51b1 expref: 10 pid: 5844 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782721.393673:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904513280 00000100:00100000:2.0:1787782721.393676:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904513280 00010000:00010000:2.0:1787782721.393685:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3141254200/0x6d98ed19b636ff9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51aa expref: 11 pid: 5846 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782721.393702:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:2.0:1787782721.393709:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ceacfe35-7480-471c-a7cd-7a05a1613220+11:2350:x1874625904513152:12345-192.168.202.15@tcp:103: 00010000:00010000:2.0:1787782721.393722:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782721.393727:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31013a1a00/0x6d98ed19b637000 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51b1 expref: 11 pid: 5844 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782721.393739:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31013a1a00/0x6d98ed19b637000 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51b1 expref: 11 pid: 5844 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782721.393758:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782721.393797:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ceacfe35-7480-471c-a7cd-7a05a1613220+11:2350:x1874625904513152:12345-192.168.202.15@tcp:103: Request processed in 88us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782721.393821:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:2.0:1787782721.393836:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:2.0:1787782721.393842:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2350:x1874625904513280:12345-192.168.202.15@tcp:103: 00010000:00010000:2.0:1787782721.393849:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782721.393853:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3141254200/0x6d98ed19b636ff9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51aa expref: 10 pid: 5846 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782721.393862:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3141254200/0x6d98ed19b636ff9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51aa expref: 10 pid: 5846 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782721.393873:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c31421fc600/0x6d98ed19b637038 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782721.393882:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31421fc600/0x6d98ed19b637038 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782721.393896:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c31421fc600/0x6d98ed19b637038 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782721.393903:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c31421fc600/0x6d98ed19b637038 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782721.393911:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c31421fc600/0x6d98ed19b637038 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782721.393918:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c31421fc600/0x6d98ed19b637038 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782721.393924:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fc600 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787782721.393928:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c31421fc600/0x6d98ed19b637038 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782721.393941:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c31421fc600/0x6d98ed19b637038 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782721.393963:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c31421fc600/0x6d98ed19b637038 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782721.393975:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782721.393992:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2350:x1874625904513280:12345-192.168.202.15@tcp:103: Request processed in 150us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782721.393998:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00010000:00010000:1.0:1787782721.395413:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31013a1a00/0x6d98ed19b637000 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51b1 expref: 9 pid: 5844 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.395449:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1343c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922361088:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782721.395463:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3141254200/0x6d98ed19b636ff9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51aa expref: 8 pid: 5846 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782721.395471:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1352c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8449:1874625922361216:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782721.395512:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c31421fc600/0x6d98ed19b637038 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.395521:0:8449:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c31421fc600/0x6d98ed19b637038 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.395526:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c31421fc600/0x6d98ed19b637038 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782721.395531:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31421fc600/0x6d98ed19b637038 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782721.889749:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782722.918540:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782723.089616:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782723.089670:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782723.089754:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782723.089784:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782723.089844:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904513408 00000100:00100000:1.0:1787782723.089854:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904513408 00000100:00100000:1.0:1787782723.089909:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 130 00000100:00100000:1.0:1787782723.089918:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31091b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+8:2352:x1874625904513408:12345-192.168.202.15@tcp:400: 00000100:00100000:1.0:1787782723.089986:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31091b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+8:2352:x1874625904513408:12345-192.168.202.15@tcp:400: Request processed in 69us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782723.089993:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 130 00000100:00100000:0.0:1787782723.091965:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904513536 00000100:00100000:0.0:1787782723.091978:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904513536 00000100:00100000:0.0:1787782723.092046:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:0.0:1787782723.092056:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2352:x1874625904513536:12345-192.168.202.15@tcp:400: 00000100:00100000:0.0:1787782723.092149:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2352:x1874625904513536:12345-192.168.202.15@tcp:400: Request processed in 95us (2395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782723.092156:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00080000:2.0:1787782723.092267:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782723.092794:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904513664 00000100:00100000:3.0:1787782723.092873:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904513664 00000100:00100000:3.0:1787782723.092971:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904513792 00000100:00100000:3.0:1787782723.092975:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904513792 00000100:00100000:0.0:1787782723.093027:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:0.0:1787782723.093037:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2352:x1874625904513664:12345-192.168.202.15@tcp:400: 00000100:00100000:0.0:1787782723.093086:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2352:x1874625904513664:12345-192.168.202.15@tcp:400: Request processed in 50us (3417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782723.093113:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00080000:2.0:1787782723.093667:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787782723.093671:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787782723.094032:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:3.0:1787782723.094042:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2352:x1874625904513792:12345-192.168.202.15@tcp:400: 00000100:00100000:3.0:1787782723.094111:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2352:x1874625904513792:12345-192.168.202.15@tcp:400: Request processed in 56us (4311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782723.094117:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 10000000:01000000:2.0:1787782723.236302:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787782723.236310:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c310712b000 from 39 10000000:01000000:2.0:1787782723.236316:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787782723.236365:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782723.236376:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782723.236387:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782723.236411:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922363136:0@lo:101: 00000100:00100000:2.0:1787782723.236492:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782723.236557:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3105112b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787782723.236693:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922363136 00000100:00100000:3.0:1787782723.236701:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922363136 00000100:00100000:3.0:1787782723.236752:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787782723.236762:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31091b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+12:5848:x1874625922363136:12345-0@lo:101: 00010000:00010000:3.0:1787782723.236774:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782723.236786:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31029f5000/0x6d98ed19b637046 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b63703f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782723.236806:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31029f5000/0x6d98ed19b637046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b63703f expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782723.236832:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31029f5000/0x6d98ed19b637046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b63703f expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782723.236841:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31029f5000, rc 0) 00000100:00100000:3.0:1787782723.236888:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31091b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:5848:x1874625922363136:12345-0@lo:101: Request processed in 128us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782723.236895:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787782723.236996:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922363136:0@lo:101: 00010000:00010000:2.0:1787782723.237016:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637046 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782723.237024:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b637046 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782723.237073:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922363264:0@lo:501: 00000100:00100000:2.0:1787782723.237132:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782723.237161:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3105112b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787782723.237270:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922363264 00000100:00100000:3.0:1787782723.237275:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922363264 00000100:00100000:3.0:1787782723.237307:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787782723.237315:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:5848:x1874625922363264:12345-0@lo:501: 00000100:00100000:3.0:1787782723.237571:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:5848:x1874625922363264:12345-0@lo:501: Request processed in 257us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782723.237578:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787782723.239610:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922363264:0@lo:501: 00000100:00100000:2.0:1787782723.239668:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922363392:0@lo:503: 00000100:00100000:2.0:1787782723.239733:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782723.239776:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3105112b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782723.240267:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922363392 00000100:00100000:0.0:1787782723.240273:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922363392 00000100:00100000:0.0:1787782723.240328:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787782723.240343:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:5848:x1874625922363392:12345-0@lo:503: 00000100:00100000:0.0:1787782723.240543:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:5848:x1874625922363392:12345-0@lo:503: Request processed in 206us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782723.240550:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787782723.240656:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922363392:0@lo:503: 00000100:00100000:1.0:1787782723.241033:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1352c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8468:1874625922363520:0@lo:502: 00000100:00100000:1.0:1787782723.241073:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782723.241141:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c313455d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787782723.241216:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922363520 00000100:00100000:3.0:1787782723.241220:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922363520 00000100:00100000:3.0:1787782723.241266:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787782723.241274:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:8468:x1874625922363520:12345-0@lo:502: 00000100:00100000:3.0:1787782723.241976:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+13:8468:x1874625922363520:12345-0@lo:502: Request processed in 700us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782723.241985:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787782723.242078:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1352c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8468:1874625922363520:0@lo:502: 00000100:00100000:1.0:1787782723.242147:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1352c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8468:1874625922363648:0@lo:502: 00000100:00100000:1.0:1787782723.242185:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782723.242219:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c313455d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787782723.242285:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922363648 00000100:00100000:2.0:1787782723.242290:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922363648 00000100:00100000:2.0:1787782723.242324:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787782723.242332:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:8468:x1874625922363648:12345-0@lo:502: 00000100:00100000:2.0:1787782723.242509:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:8468:x1874625922363648:12345-0@lo:502: Request processed in 177us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782723.242515:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787782723.242626:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1352c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8468:1874625922363648:0@lo:502: 00000040:00080000:1.0:1787782723.242645:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787782723.242897:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787782723.242914:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787782723.242923:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637046 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782723.242933:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637046 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782723.242949:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787782723.242951:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787782723.242954:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787782723.242977:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782723.242984:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782723.242993:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782723.243006:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922363776:0@lo:101: 00000100:00100000:2.0:1787782723.243033:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782723.243059:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3105112240 going to sleep for 11 seconds 00000100:00100000:1.0:1787782723.243289:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922363776 00000100:00100000:1.0:1787782723.243294:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922363776 00000100:00100000:1.0:1787782723.243326:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787782723.243333:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+13:5848:x1874625922363776:12345-0@lo:101: 00010000:00010000:1.0:1787782723.243342:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782723.243353:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31421fd400/0x6d98ed19b637054 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b63704d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782723.243374:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31421fd400/0x6d98ed19b637054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b63704d expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782723.243383:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31421fd400/0x6d98ed19b637054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b63704d expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782723.243392:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31421fd400, rc 0) 00000100:00100000:3.0:1787782723.243551:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070ff0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922363776:0@lo:101: 00010000:00010000:3.0:1787782723.243566:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637054 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782723.243575:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b637054 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782723.243627:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f388780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922363904:0@lo:501: 00000100:00100000:3.0:1787782723.243654:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782723.243684:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2540 going to sleep for 11 seconds 00000100:00100000:1.0:1787782723.243720:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:5848:x1874625922363776:12345-0@lo:101: Request processed in 386us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782723.243726:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787782723.243747:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922363904 00000100:00100000:1.0:1787782723.243751:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922363904 00000100:00100000:1.0:1787782723.243778:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787782723.243791:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:5848:x1874625922363904:12345-0@lo:501: 00000100:00100000:1.0:1787782723.244002:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:5848:x1874625922363904:12345-0@lo:501: Request processed in 210us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782723.244008:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787782723.244141:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f388780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922363904:0@lo:501: 00000100:00100000:3.0:1787782723.244167:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f388780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922364032:0@lo:503: 00000100:00100000:3.0:1787782723.244203:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782723.244219:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2540 going to sleep for 11 seconds 00000100:00100000:1.0:1787782723.244347:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922364032 00000100:00100000:1.0:1787782723.244351:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922364032 00000100:00100000:1.0:1787782723.246334:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787782723.246354:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:5848:x1874625922364032:12345-0@lo:503: 00000100:00100000:1.0:1787782723.246580:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+14:5848:x1874625922364032:12345-0@lo:503: Request processed in 235us (2375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782723.246587:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787782723.246694:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f388780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922364032:0@lo:503: 00000100:00100000:3.0:1787782723.247380:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f388780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8469:1874625922364160:0@lo:502: 00000100:00100000:3.0:1787782723.247476:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782723.251850:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3132166c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782723.252110:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922364160 00000100:00100000:0.0:1787782723.252120:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922364160 00000100:00100000:0.0:1787782723.252170:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787782723.252180:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+14:8469:x1874625922364160:12345-0@lo:502: 00000100:00100000:0.0:1787782723.252479:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+14:8469:x1874625922364160:12345-0@lo:502: Request processed in 299us (5001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782723.252487:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787782723.253331:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f388780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8469:1874625922364160:0@lo:502: 00000020:01000000:3.0:1787782723.253379:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782723.253390:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782723.253393:0:8469:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787782723.253399:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787782723.253435:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f388780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8469:1874625922364288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782723.253484:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782723.253522:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2540 going to sleep for 11 seconds 00000100:00100000:0.0:1787782723.256710:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922364288 00000100:00100000:0.0:1787782723.256726:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922364288 00000100:00100000:0.0:1787782723.256780:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787782723.256790:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+14:8469:x1874625922364288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782723.257078:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+14:8469:x1874625922364288:12345-0@lo:502:llog_process_th.0 Request processed in 288us (3592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782723.257086:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787782723.257373:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f388780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8469:1874625922364288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787782723.257408:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782723.257415:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782723.257418:0:8469:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787782723.257423:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787782723.259140:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787782723.259169:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787782723.259180:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637054 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782723.259190:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637054 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782723.259200:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787782723.259203:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c3129b5d800 from 39 10000000:01000000:0.0:1787782723.259205:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787782723.259306:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782723.259314:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782723.259324:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782723.259964:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922364416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787782723.260031:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782723.260129:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787782723.264997:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922364416 00000100:00100000:3.0:1787782723.265012:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922364416 00000100:00100000:3.0:1787782723.265158:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787782723.265168:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+14:5848:x1874625922364416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787782723.265185:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782723.265202:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31029f5e00/0x6d98ed19b637062 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b63705b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782723.265228:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31029f5e00/0x6d98ed19b637062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b63705b expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782723.265255:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31029f5e00/0x6d98ed19b637062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b63705b expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782723.265264:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31029f5e00, rc 0) 00000100:00100000:0.0:1787782723.265570:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922364416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782723.265590:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637062 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782723.265614:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b637062 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782723.265683:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922364544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782723.267836:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782723.271816:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787782723.271887:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922364416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 6715us (11850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782723.271902:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787782723.275557:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922364544 00000100:00100000:1.0:1787782723.275571:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922364544 00000100:00100000:1.0:1787782723.275638:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787782723.275649:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922364544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782723.275952:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922364544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (8120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782723.275960:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787782723.276302:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922364544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782723.276353:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922364672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782723.276398:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782723.276700:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787782723.276759:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922364672 00000100:00100000:2.0:1787782723.276764:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922364672 00000100:00100000:2.0:1787782723.276795:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787782723.276802:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922364672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782723.276955:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922364672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782723.276963:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787782723.277040:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922364672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782723.277434:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8470:1874625922364800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782723.277472:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782723.277540:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787782723.281681:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922364800 00000100:00100000:2.0:1787782723.281700:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922364800 00000100:00100000:2.0:1787782723.281757:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787782723.281766:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+15:8470:x1874625922364800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782723.282160:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+15:8470:x1874625922364800:12345-0@lo:502:llog_process_th.0 Request processed in 395us (4687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782723.282175:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787782723.285400:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8470:1874625922364800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782723.285482:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8470:1874625922364928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782723.285554:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782723.285590:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787782723.285605:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922364928 00000100:00100000:1.0:1787782723.285611:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922364928 00000100:00100000:1.0:1787782723.285664:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787782723.285674:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+15:8470:x1874625922364928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787782723.285928:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+15:8470:x1874625922364928:12345-0@lo:502:llog_process_th.0 Request processed in 255us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782723.285936:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787782723.289245:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8470:1874625922364928:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787782723.289297:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787782723.289489:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787782723.289507:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787782723.289518:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637062 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782723.289528:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637062 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782723.289537:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787782723.289540:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787782723.289543:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787782723.289582:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782723.289589:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782723.289598:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782723.289618:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922365056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787782723.289675:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782723.289713:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3105112240 going to sleep for 11 seconds 00000100:00100000:0.0:1787782723.289761:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922365056 00000100:00100000:0.0:1787782723.289767:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922365056 00000100:00100000:0.0:1787782723.289811:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787782723.289829:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+15:5848:x1874625922365056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782723.289842:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782723.289854:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141254800/0x6d98ed19b637070 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b637069 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782723.289877:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141254800/0x6d98ed19b637070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b637069 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782723.289887:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141254800/0x6d98ed19b637070 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b637069 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782723.289895:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254800, rc 0) 00000100:00100000:0.0:1787782723.289946:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922365056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782723.289954:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787782723.290025:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922365056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782723.290044:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637070 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782723.290052:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b637070 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782723.290134:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1352c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922365184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782723.290162:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782723.290181:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c313455dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782723.290249:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922365184 00000100:00100000:0.0:1787782723.290253:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922365184 00000100:00100000:0.0:1787782723.290283:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787782723.290291:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922365184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782723.290528:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922365184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782723.290535:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787782723.290842:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1352c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922365184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787782723.290877:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f388780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922365312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787782723.290933:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782723.290956:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3132166480 going to sleep for 11 seconds 00000100:00100000:1.0:1787782723.293268:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922365312 00000100:00100000:1.0:1787782723.293282:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922365312 00000100:00100000:1.0:1787782723.293331:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787782723.293341:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922365312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787782723.293586:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922365312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (2650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782723.293593:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787782723.293852:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f388780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922365312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782723.294365:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8471:1874625922365440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782723.294412:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782723.294459:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787782723.294499:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922365440 00000100:00100000:1.0:1787782723.294504:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922365440 00000100:00100000:1.0:1787782723.294535:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787782723.294542:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+16:8471:x1874625922365440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787782723.294700:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+16:8471:x1874625922365440:12345-0@lo:502:llog_process_th.0 Request processed in 158us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782723.294707:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787782723.294774:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8471:1874625922365440:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787782723.294798:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787782723.294812:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782723.294815:0:8471:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787782723.294820:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787782723.294840:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8471:1874625922365568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782723.294872:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782723.294895:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787782723.294935:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922365568 00000100:00100000:1.0:1787782723.294939:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922365568 00000100:00100000:1.0:1787782723.294967:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787782723.294973:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+16:8471:x1874625922365568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787782723.295121:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+16:8471:x1874625922365568:12345-0@lo:502:llog_process_th.0 Request processed in 148us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782723.295128:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787782723.295153:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8471:1874625922365568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787782723.295170:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782723.295174:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782723.295180:0:8471:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787782723.295184:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787782723.295458:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787782723.295476:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787782723.295486:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637070 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782723.295496:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637070 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782723.295507:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787782723.295511:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c311846c800 from 39 10000000:01000000:1.0:1787782723.295514:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787782723.295538:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782723.295547:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782723.295557:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782723.295572:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1343c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922365696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787782723.295600:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782723.295630:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c313455dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782723.295675:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922365696 00000100:00100000:2.0:1787782723.295680:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922365696 00000100:00100000:2.0:1787782723.295713:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787782723.295720:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922365696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782723.295728:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782723.295746:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c312f294e00/0x6d98ed19b63707e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b637077 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782723.295768:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c312f294e00/0x6d98ed19b63707e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b637077 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782723.295779:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c312f294e00/0x6d98ed19b63707e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b637077 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782723.295787:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312f294e00, rc 0) 00000100:00100000:2.0:1787782723.295825:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922365696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782723.295831:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787782723.295899:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1343c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922365696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782723.295912:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63707e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782723.295927:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b63707e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782723.295969:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1343c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922365824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782723.295993:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782723.296013:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c313455dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782723.296074:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922365824 00000100:00100000:0.0:1787782723.296078:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922365824 00000100:00100000:0.0:1787782723.296137:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787782723.296144:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922365824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782723.296374:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922365824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782723.296381:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787782723.296483:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1343c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922365824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787782723.296512:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f388780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922365952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787782723.296604:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782723.296678:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787782723.296750:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922365952 00000100:00100000:2.0:1787782723.296754:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922365952 00000100:00100000:2.0:1787782723.296777:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787782723.296783:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922365952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782723.296918:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922365952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782723.296925:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787782723.296949:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f388780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922365952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787782723.297482:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f388780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8472:1874625922366080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782723.297518:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782723.297544:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2000 going to sleep for 11 seconds 00000100:00100000:0.0:1787782723.297586:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922366080 00000100:00100000:0.0:1787782723.297591:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922366080 00000100:00100000:0.0:1787782723.297624:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787782723.297632:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:8472:x1874625922366080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782723.297790:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:8472:x1874625922366080:12345-0@lo:502:llog_process_th.0 Request processed in 159us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782723.297797:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787782723.297817:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f388780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8472:1874625922366080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782723.297851:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f388780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8472:1874625922366208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782723.297883:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782723.297904:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3132166480 going to sleep for 11 seconds 00000100:00100000:2.0:1787782723.297947:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922366208 00000100:00100000:2.0:1787782723.297951:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922366208 00000100:00100000:2.0:1787782723.297979:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787782723.297986:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+17:8472:x1874625922366208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782723.298131:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+17:8472:x1874625922366208:12345-0@lo:502:llog_process_th.0 Request processed in 145us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782723.298137:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787782723.298266:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f388780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8472:1874625922366208:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787782723.298285:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787782723.298413:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787782723.298430:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787782723.298438:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63707e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782723.298447:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63707e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782723.298467:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787782723.298469:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787782723.298471:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787782723.298492:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782723.298499:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782723.298508:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782723.298521:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922366336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787782723.298547:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782723.298576:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782723.298938:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922366336 00000100:00100000:3.0:1787782723.298943:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922366336 00000100:00100000:3.0:1787782723.298974:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787782723.298981:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922366336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787782723.298990:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782723.299000:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31029f4800/0x6d98ed19b63708c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b637085 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782723.299021:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31029f4800/0x6d98ed19b63708c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b637085 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782723.299039:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31029f4800/0x6d98ed19b63708c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b637085 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782723.299048:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31029f4800, rc 0) 00000100:00100000:3.0:1787782723.299085:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922366336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782723.299091:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787782723.299134:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922366336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782723.299147:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63708c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782723.299155:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b63708c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782723.299198:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922366464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782723.299222:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782723.299257:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782723.299272:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922366464 00000100:00100000:1.0:1787782723.299277:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922366464 00000100:00100000:1.0:1787782723.299307:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787782723.299314:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922366464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782723.299778:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922366464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 463us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782723.299785:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787782723.299829:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922366464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782723.299856:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922366592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782723.301032:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782723.301077:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782723.301269:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922366592 00000100:00100000:2.0:1787782723.301286:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922366592 00000100:00100000:2.0:1787782723.301322:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787782723.301330:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922366592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782723.301530:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922366592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782723.301537:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787782723.305050:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922366592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782723.308720:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8473:1874625922366720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782723.308812:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782723.308866:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3133f9d780 going to sleep for 11 seconds 00000100:00100000:1.0:1787782723.309454:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922366720 00000100:00100000:1.0:1787782723.309461:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922366720 00000100:00100000:1.0:1787782723.309514:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787782723.309524:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:8473:x1874625922366720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787782723.309771:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:8473:x1874625922366720:12345-0@lo:502:llog_process_th.0 Request processed in 248us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782723.309778:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787782723.309884:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fde00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8473:1874625922366720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787782723.309925:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782723.309935:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782723.309937:0:8473:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787782723.309944:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787782723.309971:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8473:1874625922366848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782723.310008:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782723.310034:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3105112780 going to sleep for 11 seconds 00000100:00100000:1.0:1787782723.310217:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922366848 00000100:00100000:1.0:1787782723.310222:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922366848 00000100:00100000:1.0:1787782723.310254:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787782723.310261:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+18:8473:x1874625922366848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787782723.310387:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+18:8473:x1874625922366848:12345-0@lo:502:llog_process_th.0 Request processed in 126us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782723.310400:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787782723.310554:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8473:1874625922366848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787782723.310572:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782723.310576:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782723.310578:0:8473:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787782723.310581:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787782723.310677:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787782723.310698:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787782723.310707:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63708c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782723.310717:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63708c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782723.310727:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787782723.310729:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c31091e8000 from 1 10000000:01000000:0.0:1787782723.310732:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787782723.310753:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b637093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782723.310761:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b637093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782723.310769:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b637093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782723.310782:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922366976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787782723.310809:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782723.310844:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311863d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787782723.311183:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922366976 00000100:00100000:1.0:1787782723.311189:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922366976 00000100:00100000:1.0:1787782723.311221:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787782723.311229:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922366976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782723.311246:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782723.311259:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b63709a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b637093 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782723.311280:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b63709a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b637093 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782723.311291:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b63709a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b637093 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782723.311300:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31421fcc00, rc 0) 00000100:00100000:1.0:1787782723.311340:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922366976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782723.311346:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787782723.311366:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922366976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782723.311378:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b637093 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63709a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782723.311388:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b637093 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b63709a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782723.311432:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922367104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782723.311457:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782723.311479:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311863d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787782723.312188:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922367104 00000100:00100000:1.0:1787782723.312194:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922367104 00000100:00100000:1.0:1787782723.312221:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787782723.312228:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922367104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782723.312463:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922367104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (1005us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787782723.312470:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787782723.312541:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922367104:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787782723.312567:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787782723.312573:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b637093 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63709a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782723.312582:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b637093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63709a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782723.937435:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782724.962130:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782725.217639:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922367616:0@lo:400:kworker.0 00000100:00100000:1.0:1787782725.217744:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782725.217818:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787782725.217825:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922367232:0@lo:400:kworker.0 00000100:00100000:1.0:1787782725.217855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782725.217879:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922367744:0@lo:400:kworker.0 00000100:00100000:1.0:1787782725.217901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782725.217930:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922367232 00000100:00100000:1.0:1787782725.217937:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922367232 00000100:00100000:1.0:1787782725.217983:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787782725.217992:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922367232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782725.218190:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922367232:12345-0@lo:400:kworker.0 Request processed in 198us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782725.218198:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787782725.218259:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922367232:0@lo:400:kworker.0 00000100:00100000:0.0:1787782725.218498:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922367616 00000100:00100000:0.0:1787782725.218503:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922367616 00000100:00100000:0.0:1787782725.218556:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787782725.218563:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f135e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922367616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782725.218609:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f135e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922367616:12345-0@lo:400:kworker.0 Request processed in 46us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782725.218616:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787782725.218628:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625922367488:0@lo:400:kworker.0 00000100:00100000:0.0:1787782725.218637:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922367744 00000100:00100000:0.0:1787782725.218642:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922367744 00000100:00100000:3.0:1787782725.218666:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782725.218671:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787782725.218692:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f134f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922367744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782725.218693:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787782725.218705:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625922367360:0@lo:400:kworker.0 00000100:00100000:3.0:1787782725.218745:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782725.218745:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f134f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922367744:12345-0@lo:400:kworker.0 Request processed in 61us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782725.218757:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787782725.218769:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922367872:0@lo:400:kworker.0 00000100:00100000:0.0:1787782725.218772:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922367488 00000100:00100000:0.0:1787782725.218785:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922367488 00000100:00100000:3.0:1787782725.218796:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782725.218820:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922367360 00000100:00100000:0.0:1787782725.218824:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922367360 00000100:00100000:0.0:1787782725.218849:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787782725.218857:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f388780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625922367488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782725.218897:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787782725.218902:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f388780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625922367488:12345-0@lo:400:kworker.0 Request processed in 44us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782725.218910:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f38a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625922367360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782725.218912:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787782725.218936:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922367872 00000100:00100000:0.0:1787782725.218941:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922367872 00000100:00100000:3.0:1787782725.218951:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f38a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625922367360:12345-0@lo:400:kworker.0 Request processed in 44us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782725.218959:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787782725.218973:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787782725.218981:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f38ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922367872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782725.219005:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625922367360:0@lo:400:kworker.0 00010000:00080000:3.0:1787782725.219023:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31345fc780 x1874625922367872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782725.219035:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922367872:0@lo:400:kworker.0 00000100:00100000:0.0:1787782725.219038:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f38ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922367872:12345-0@lo:400:kworker.0 Request processed in 42us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782725.219047:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787782725.219050:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625922367488:0@lo:400:kworker.0 00000100:00100000:0.0:1787782725.219087:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922367744:0@lo:400:kworker.0 00010000:00080000:0.0:1787782725.219137:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31345fc000 x1874625922367616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782725.219147:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922367616:0@lo:400:kworker.0 00000100:00080000:1.0:1787782725.219556:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787782725.219562:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787782725.219564:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787782725.322601:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782725.322977:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904513920 00000100:00100000:0.0:1787782725.322987:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904513920 00000100:00100000:0.0:1787782725.323041:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 164 00000100:00100000:0.0:1787782725.323051:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+8:5590:x1874625904513920:12345-192.168.202.15@tcp:101: 00010000:00010000:0.0:1787782725.323067:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782725.323087:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141255600/0x6d98ed19b6370a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e5213 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782725.324948:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141255600/0x6d98ed19b6370a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5213 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782725.324960:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141255600/0x6d98ed19b6370a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5213 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782725.324969:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255600, rc 0) 00000100:00100000:0.0:1787782725.325110:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+9:5590:x1874625904513920:12345-192.168.202.15@tcp:101: Request processed in 2043us (2502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782725.325120:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 164 00000100:00100000:1.0:1787782725.330160:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782725.330224:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904514048 00000100:00100000:2.0:1787782725.330234:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904514048 00000100:00100000:2.0:1787782725.330300:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 165 00000100:00100000:2.0:1787782725.330310:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+9:5590:x1874625904514048:12345-192.168.202.15@tcp:501: 00000100:00100000:2.0:1787782725.331034:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+9:5590:x1874625904514048:12345-192.168.202.15@tcp:501: Request processed in 725us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782725.331043:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 165 00000100:00100000:2.0:1787782725.335648:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782725.336010:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904514176 00000100:00100000:0.0:1787782725.336019:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904514176 00000100:00100000:0.0:1787782725.336087:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 166 00000100:00100000:0.0:1787782725.336116:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+9:5590:x1874625904514176:12345-192.168.202.15@tcp:503: 00000100:00100000:0.0:1787782725.336363:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+9:5590:x1874625904514176:12345-192.168.202.15@tcp:503: Request processed in 266us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782725.336371:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 166 00000100:00100000:0.0:1787782725.344917:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782725.344976:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904514304 00000100:00100000:2.0:1787782725.344986:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904514304 00000100:00100000:2.0:1787782725.345034:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 167 00000100:00100000:2.0:1787782725.345041:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+9:6075:x1874625904514304:12345-192.168.202.15@tcp:502: 00000100:00100000:2.0:1787782725.345402:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+9:6075:x1874625904514304:12345-192.168.202.15@tcp:502: Request processed in 360us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782725.345496:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 167 00000100:00100000:2.0:1787782725.347644:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782725.347724:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904514432 00000100:00100000:1.0:1787782725.347732:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904514432 00000100:00100000:1.0:1787782725.347790:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 168 00000100:00100000:1.0:1787782725.347802:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+9:6075:x1874625904514432:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787782725.348088:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+9:6075:x1874625904514432:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 288us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782725.348127:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 168 00000100:00100000:0.0:1787782725.350790:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782725.350846:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904514560 00000100:00100000:2.0:1787782725.350854:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904514560 00000100:00100000:2.0:1787782725.350898:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 169 00000100:00100000:2.0:1787782725.350906:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+9:5590:x1874625904514560:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782725.350918:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782725.350933:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c312f295200/0x6d98ed19b6370a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e521a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782725.350971:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c312f295200/0x6d98ed19b6370a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e521a expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782725.350979:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c312f295200/0x6d98ed19b6370a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e521a expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782725.350987:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312f295200, rc 0) 00000100:00100000:2.0:1787782725.351038:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5590:x1874625904514560:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 134us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782725.351043:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 169 00000100:00100000:0.0:1787782725.352854:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782725.352927:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904514688 00000100:00100000:1.0:1787782725.352942:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904514688 00000100:00100000:1.0:1787782725.352988:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 170 00000100:00100000:1.0:1787782725.352994:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5590:x1874625904514688:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782725.353352:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5590:x1874625904514688:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 356us (500us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787782725.353360:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 170 00000100:00100000:3.0:1787782725.729631:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922368000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782725.729703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782725.729913:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922368000 00000100:00100000:1.0:1787782725.729921:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922368000 00000100:00100000:2.0:1787782725.729979:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787782725.729992:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922368000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787782725.730028:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782725.730053:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787782725.730067:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922368128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782725.730125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782725.730529:0:6701:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1787782725.730538:0:6701:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1787782725.730649:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922368128 00000100:00100000:0.0:1787782725.730653:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922368128 00000100:00100000:0.0:1787782725.730736:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787782725.730743:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f135a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922368128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787782725.730767:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782725.730863:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f135a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922368128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782725.730869:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787782725.732023:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922368000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2030us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782725.732031:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787782725.733342:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31070fc000 x1874625922368000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782725.733367:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922368000:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787782725.748429:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31070fcb40 x1874625922368128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782725.748458:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922368128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787782725.985376:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787782726.812053:0:8513:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca3a2a990 20000000:00000080:1.0:1787782726.812071:0:8513:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c3134045000 uarg=0000000000000000 20000000:01000000:1.0:1787782726.812135:0:8513:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787782726.812141:0:8513:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787782726.812146:0:8513:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787782726.818659:0:8514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787782726.818870:0:8513:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787782726.829759:0:8513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787782726.829820:0:8513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787782726.829879:0:8513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787782726.829899:0:8513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787782726.829918:0:8513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c3141255400/0x6d98ed19b6370af lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782726.829936:0:8513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31421fda00/0x6d98ed19b636e24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636e1d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782726.829944:0:8513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3100031c00/0x6d98ed19b636e86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636e7f expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782726.829951:0:8513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636f51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b636f4a expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782726.829962:0:8513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31013a0e00/0x6d98ed19b63700e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e51e2 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782726.829971:0:8513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c3141255400/0x6d98ed19b6370af lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782726.830011:0:8513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31013a0e00/0x6d98ed19b63700e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51e2 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782726.830027:0:8513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c31013a0e00/0x6d98ed19b63700e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51e2 expref: 9 pid: 5846 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782726.830054:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1874625922368256:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787782726.831054:0:8513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636f51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636f4a expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782726.831066:0:8513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636f51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636f4a expref: 18 pid: 5846 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782726.831078:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fe580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1874625922368384:0@lo:104: 00000100:00100000:0.0:1787782726.831168:0:8513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787782726.831216:0:8513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3100031c00/0x6d98ed19b636e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636e7f expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782726.831225:0:8513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c3100031c00/0x6d98ed19b636e86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636e7f expref: 18 pid: 5845 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782726.831234:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fc780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1874625922368512:0@lo:104: 00000100:00100000:0.0:1787782726.831259:0:8513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787782726.831284:0:8513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31421fda00/0x6d98ed19b636e24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b636e1d expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782726.831292:0:8513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c31421fda00/0x6d98ed19b636e24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b636e1d expref: 18 pid: 5845 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782726.831300:0:8513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ff0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1874625922368640:0@lo:104: 00000100:00100000:0.0:1787782726.831318:0:8513:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3134015300 going to sleep for 11 seconds 00000100:00100000:3.0:1787782726.831637:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787782726.831657:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782726.831670:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922368384 00000100:00100000:3.0:1787782726.831675:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922368384 00000100:00100000:3.0:1787782726.831722:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922368512 00000100:00100000:3.0:1787782726.831726:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922368512 00000100:00100000:3.0:1787782726.831735:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922368640 00000100:00100000:3.0:1787782726.831738:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922368640 00000100:00100000:3.0:1787782726.831749:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787782726.831757:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+5:8513:x1874625922368384:12345-0@lo:104: 00010000:00010000:3.0:1787782726.831771:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636f4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636f51 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.831836:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787782726.831843:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+5:8513:x1874625922368384:12345-0@lo:104: Request processed in 87us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782726.831851:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787782726.831868:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787782726.831874:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310963d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+4:8513:x1874625922368512:12345-0@lo:104: 00010000:00010000:3.0:1787782726.831882:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31029f5400/0x6d98ed19b636e7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636e86 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.831936:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787782726.831941:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310963d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+4:8513:x1874625922368512:12345-0@lo:104: Request processed in 68us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782726.831948:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787782726.831981:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787782726.831987:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+3:8513:x1874625922368640:12345-0@lo:104: 00010000:00010000:3.0:1787782726.831994:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b636e1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636e24 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.832026:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787782726.832030:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+3:8513:x1874625922368640:12345-0@lo:104: Request processed in 44us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782726.832036:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787782726.832052:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787782726.832058:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636f4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636f51 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.832066:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fce00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782726.832070:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636f4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636f51 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.832079:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636f4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636f51 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782726.832087:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636f4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636f51 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782726.832110:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787782726.832157:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636f4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f51 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.832164:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782726.832186:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636f4a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f51 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.832194:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31421fce00/0x6d98ed19b636f4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636f51 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.832217:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787782726.832221:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31029f5400/0x6d98ed19b636e7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636e86 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.832227:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f5400 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782726.832231:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31029f5400/0x6d98ed19b636e7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636e86 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.832238:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31029f5400/0x6d98ed19b636e7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636e86 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782726.832439:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fe580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1874625922368384:0@lo:104: 00000100:00100000:0.0:1787782726.832449:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fc780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1874625922368512:0@lo:104: 00000100:00100000:0.0:1787782726.832465:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ff0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1874625922368640:0@lo:104: 10000000:00010000:3.0:1787782726.833623:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31029f5400/0x6d98ed19b636e7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636e86 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782726.833630:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787782726.833673:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31029f5400/0x6d98ed19b636e7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636e86 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.833681:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782726.833699:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31029f5400/0x6d98ed19b636e7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636e86 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.833722:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31029f5400/0x6d98ed19b636e7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636e86 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.833739:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782726.833743:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b636e1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b636e24 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.833750:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0600 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782726.833753:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b636e1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b636e24 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.833760:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b636e1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b636e24 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782726.833766:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b636e1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b636e24 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782726.833771:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787782726.833785:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b636e1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636e24 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.833791:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782726.833798:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b636e1d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636e24 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.833804:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b636e1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b636e24 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.833817:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782726.833824:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782726.833826:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782726.833836:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782726.833843:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782726.833861:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f389680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922368768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782726.833922:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782726.833990:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f389a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922369024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782726.834014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782726.834033:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787782726.834038:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f388f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922368896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782726.834056:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782726.834083:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922368768 00000100:00100000:3.0:1787782726.834089:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922368768 00010000:00010000:3.0:1787782726.834570:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636f51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636f4a expref: 19 pid: 5846 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782726.834644:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922369024 00000100:00100000:3.0:1787782726.834648:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922369024 00010000:00010000:3.0:1787782726.834664:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31421fda00/0x6d98ed19b636e24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636e1d expref: 20 pid: 5845 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782726.837185:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922368896 00000100:00100000:2.0:1787782726.837200:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922368896 00010000:00010000:2.0:1787782726.837260:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3100031c00/0x6d98ed19b636e86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636e7f expref: 21 pid: 5845 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782726.837297:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787782726.837307:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f38a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+21:3307:x1874625922368768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782726.837327:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782726.837334:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636f51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636f4a expref: 21 pid: 5846 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.837367:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636f51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636f4a expref: 21 pid: 5846 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.837403:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b636f51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636f4a expref: 21 pid: 5846 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.837892:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782726.837982:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f38a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+20:3307:x1874625922368768:12345-0@lo:103:ldlm_bl.0 Request processed in 675us (4059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782726.837990:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787782726.838013:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787782726.838020:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922369024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782726.838030:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782726.838035:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31421fda00/0x6d98ed19b636e24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636e1d expref: 19 pid: 5845 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.838044:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31421fda00/0x6d98ed19b636e24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636e1d expref: 19 pid: 5845 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.838056:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31421fda00/0x6d98ed19b636e24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636e1d expref: 19 pid: 5845 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.838078:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782726.838151:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+18:3305:x1874625922369024:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (4136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782726.838158:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787782726.838171:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787782726.838177:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+17:3305:x1874625922368896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782726.838193:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782726.838198:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3100031c00/0x6d98ed19b636e86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b636e7f expref: 17 pid: 5845 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.838217:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3100031c00/0x6d98ed19b636e86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b636e7f expref: 17 pid: 5845 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.838228:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3100031c00/0x6d98ed19b636e86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b636e7f expref: 17 pid: 5845 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.838236:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782726.838260:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:db359560-8e1a-42c0-a155-5e020d83d9a3+16:3305:x1874625922368896:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (4202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782726.838267:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787782726.838365:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f389680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922368768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782726.841565:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782726.841737:0:8513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8513:1874625922368256:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782726.841776:0:8513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c3141255400/0x6d98ed19b6370af lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782726.842078:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904514816 00000100:00100000:2.0:1787782726.842085:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904514816 00010000:00010000:2.0:1787782726.842152:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31013a0e00/0x6d98ed19b63700e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51e2 expref: 10 pid: 5846 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782726.842174:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:2.0:1787782726.842180:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2350:x1874625904514816:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782726.842193:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782726.842198:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31013a0e00/0x6d98ed19b63700e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51e2 expref: 10 pid: 5846 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.842222:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31013a0e00/0x6d98ed19b63700e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51e2 expref: 10 pid: 5846 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.842245:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31013a0e00/0x6d98ed19b63700e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e51e2 expref: 10 pid: 5846 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.842276:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c3141255400/0x6d98ed19b6370af lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.842284:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141255400/0x6d98ed19b6370af lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.842299:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3141255400/0x6d98ed19b6370af lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.842306:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3141255400/0x6d98ed19b6370af lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.842313:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c3141255400/0x6d98ed19b6370af lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.842319:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c3141255400/0x6d98ed19b6370af lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.842325:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255400 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787782726.842329:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c3141255400/0x6d98ed19b6370af lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.842336:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c3141255400/0x6d98ed19b6370af lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782726.842351:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c3141255400/0x6d98ed19b6370af lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782726.842358:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f388f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922368896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782726.842362:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782726.842368:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f389a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922369024:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787782726.842606:0:8513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c3141255400/0x6d98ed19b6370af lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782726.842622:0:8513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c3141255400/0x6d98ed19b6370af lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782726.842627:0:8513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3141255400/0x6d98ed19b6370af lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782726.844078:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ceacfe35-7480-471c-a7cd-7a05a1613220+9:2350:x1874625904514816:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 1889us (2515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782726.844122:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:3.0:1787782726.844175:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782726.844454:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904514944 00000100:00100000:3.0:1787782726.844461:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904514944 00000100:00100000:3.0:1787782726.844499:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 171 00000100:00100000:3.0:1787782726.844589:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5590:x1874625904514944:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787782726.844613:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782726.844630:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b6370b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e5221 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.844654:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b6370b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5221 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.844665:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b6370b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5221 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782726.844672:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31029f4c00, rc 0) 00000100:00100000:3.0:1787782726.844711:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+11:5590:x1874625904514944:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 204us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782726.844718:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 171 00000100:00100000:3.0:1787782726.846017:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782726.846225:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904515072 00000100:00100000:0.0:1787782726.846237:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904515072 00000100:00100000:0.0:1787782726.846280:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 172 00000100:00100000:0.0:1787782726.846289:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5590:x1874625904515072:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782726.846742:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5590:x1874625904515072:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 452us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782726.846750:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 172 00000100:00100000:2.0:1787782726.850673:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782726.850812:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904515200 00000100:00100000:0.0:1787782726.850821:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904515200 00000100:00100000:0.0:1787782726.850876:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 173 00000100:00100000:0.0:1787782726.850885:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5590:x1874625904515200:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782726.851219:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+10:5590:x1874625904515200:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 334us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782726.851227:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 173 00000100:00100000:3.0:1787782726.871174:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782726.871219:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904515328 00000100:00100000:1.0:1787782726.871230:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904515328 00000100:00100000:1.0:1787782726.871292:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 174 00000100:00100000:1.0:1787782726.871303:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:6093:x1874625904515328:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787782726.871559:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:6093:x1874625904515328:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 257us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782726.871568:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 174 00000100:00100000:3.0:1787782726.879182:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782726.880972:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904515456 00000100:00100000:0.0:1787782726.880985:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904515456 00000100:00100000:0.0:1787782726.881049:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 175 00000100:00100000:0.0:1787782726.881059:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+10:6093:x1874625904515456:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787782726.881519:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+10:6093:x1874625904515456:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 460us (2345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782726.881527:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 175 00010000:00010000:1.0:1787782727.009831:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787782727.905932:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787782727.905939:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c310712b000 from 4 10000000:01000000:0.0:1787782727.905954:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787782727.906010:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255c00/0x6d98ed19b6370bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782727.906023:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141255c00/0x6d98ed19b6370bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782727.906035:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141255c00/0x6d98ed19b6370bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782727.906062:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922369152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787782727.906172:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782727.906237:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3134015300 going to sleep for 11 seconds 00000100:00100000:1.0:1787782727.906312:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922369152 00000100:00100000:1.0:1787782727.906320:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922369152 00000100:00100000:1.0:1787782727.906387:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1787782727.906398:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922369152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782727.906412:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782727.906426:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31421fc800/0x6d98ed19b6370c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b6370bd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782727.906462:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31421fc800/0x6d98ed19b6370c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b6370bd expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782727.906474:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31421fc800/0x6d98ed19b6370c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6370bd expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782727.906496:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31421fc800, rc 0) 00000100:00100000:1.0:1787782727.906547:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922369152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782727.906553:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787782727.906825:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922369152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782727.906840:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141255c00/0x6d98ed19b6370bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6370c4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782727.906849:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141255c00/0x6d98ed19b6370bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b6370c4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782727.906903:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922369280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782727.906929:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782727.906954:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3134015300 going to sleep for 11 seconds 00000100:00100000:2.0:1787782727.907158:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922369280 00000100:00100000:2.0:1787782727.907163:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922369280 00000100:00100000:2.0:1787782727.907187:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787782727.907205:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922369280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782727.907706:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922369280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 511us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782727.907714:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787782727.907850:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922369280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782727.907891:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922369408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782727.907933:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782727.907971:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3134015300 going to sleep for 11 seconds 00000100:00100000:1.0:1787782727.908131:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922369408 00000100:00100000:1.0:1787782727.908137:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922369408 00000100:00100000:1.0:1787782727.908173:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787782727.908181:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922369408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787782727.908343:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922369408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782727.908350:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787782727.909161:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922369408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782727.932843:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8539:1874625922369536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782727.932934:0:8539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782727.933178:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922369536 00000100:00100000:1.0:1787782727.933186:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922369536 00000100:00100000:1.0:1787782727.933253:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787782727.933263:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:8539:x1874625922369536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782727.933545:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31340156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782727.934851:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:8539:x1874625922369536:12345-0@lo:502:llog_process_th.0 Request processed in 1584us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782727.934865:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787782727.935646:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8539:1874625922369536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787782727.935748:0:8539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787782727.935759:0:8539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782727.935762:0:8539:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787782727.935770:0:8539:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c310712b000 00000020:00000080:0.0:1787782727.935772:0:8539:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787782727.935863:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8539:1874625922369664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782727.935916:0:8539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782727.935954:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31340156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782727.936274:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922369664 00000100:00100000:1.0:1787782727.936282:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922369664 00000100:00100000:1.0:1787782727.936329:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787782727.936339:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3107e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+17:8539:x1874625922369664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787782727.937555:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3107e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+17:8539:x1874625922369664:12345-0@lo:502:llog_process_th.0 Request processed in 1213us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782727.937575:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787782727.957083:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8539:1874625922369664:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787782727.957166:0:8539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787782727.957179:0:8539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787782727.957181:0:8539:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787782727.957186:0:8539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787782727.957465:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787782727.957489:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787782727.957501:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255c00/0x6d98ed19b6370bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6370c4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782727.957512:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141255c00/0x6d98ed19b6370bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6370c4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782727.957524:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787782727.957526:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3129b5d800 from 4 10000000:01000000:3.0:1787782727.957529:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787782727.957581:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1a00/0x6d98ed19b6370cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782727.957598:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31013a1a00/0x6d98ed19b6370cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782727.957608:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31013a1a00/0x6d98ed19b6370cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782727.957629:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922369792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787782727.957706:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782727.957752:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782727.958764:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922369792 00000100:00100000:0.0:1787782727.958775:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922369792 00000100:00100000:0.0:1787782727.958836:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787782727.958846:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3107e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922369792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782727.958860:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782727.958877:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141255200/0x6d98ed19b6370d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b6370cb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782727.958905:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141255200/0x6d98ed19b6370d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b6370cb expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782727.958931:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141255200/0x6d98ed19b6370d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6370cb expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782727.958939:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255200, rc 0) 00000100:00100000:0.0:1787782727.961641:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3107e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922369792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2787us (3926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782727.961666:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787782727.962032:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922369792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787782727.962058:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31013a1a00/0x6d98ed19b6370cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6370d2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782727.962072:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31013a1a00/0x6d98ed19b6370cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b6370d2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782727.962175:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922369920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787782727.962243:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782727.970792:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1787782727.970878:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922369920 00000100:00100000:1.0:1787782727.970888:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922369920 00000100:00100000:1.0:1787782727.972151:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787782727.972168:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922369920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782727.972530:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922369920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 367us (10285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782727.972538:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787782727.973184:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922369920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787782727.973254:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922370048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787782727.973309:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782727.977116:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1787782727.978797:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922370048 00000100:00100000:2.0:1787782727.978810:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922370048 00000100:00100000:2.0:1787782727.978866:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787782727.978875:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922370048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782727.979129:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922370048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 254us (5819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782727.979136:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787782727.980263:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922370048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787782727.984628:0:8546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8546:1874625922370176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782727.984719:0:8546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782727.984762:0:8546:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787782727.985216:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922370176 00000100:00100000:2.0:1787782727.985225:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922370176 00000100:00100000:2.0:1787782727.985274:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787782727.985283:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:8546:x1874625922370176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782727.985691:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:8546:x1874625922370176:12345-0@lo:502:llog_process_th.0 Request processed in 408us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782727.985700:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787782727.985782:0:8546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8546:1874625922370176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787782727.985812:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782727.985822:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782727.985824:0:8546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787782727.985831:0:8546:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c3129b5d800 00000020:00000080:3.0:1787782727.985833:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787782727.985909:0:8546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8546:1874625922370304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782727.985947:0:8546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782727.985971:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922370304 00000100:00100000:3.0:1787782727.985975:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922370304 00000100:00100000:3.0:1787782727.985998:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787782727.986004:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+18:8546:x1874625922370304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782727.986147:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+18:8546:x1874625922370304:12345-0@lo:502:llog_process_th.0 Request processed in 142us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782727.986154:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787782727.986191:0:8546:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787782727.986214:0:8546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8546:1874625922370304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787782727.986230:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782727.986246:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782727.986248:0:8546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787782727.986251:0:8546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787782727.986302:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787782727.986321:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787782727.986331:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1a00/0x6d98ed19b6370cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6370d2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782727.986353:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31013a1a00/0x6d98ed19b6370cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6370d2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782727.986362:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787782727.986364:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c311846c800 from 4 10000000:01000000:3.0:1787782727.986379:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787782727.986402:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b6370d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782727.987613:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b6370d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782727.987625:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b6370d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782727.987646:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922370432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787782727.987691:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782727.987723:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911c180 going to sleep for 11 seconds 00000100:00100000:2.0:1787782727.989047:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922370432 00000100:00100000:2.0:1787782727.989062:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922370432 00000100:00100000:2.0:1787782727.990838:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787782727.990868:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922370432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782727.990885:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782727.990902:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c312f295a00/0x6d98ed19b6370e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b6370d9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782727.990931:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c312f295a00/0x6d98ed19b6370e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b6370d9 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782727.990942:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c312f295a00/0x6d98ed19b6370e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6370d9 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782727.990950:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312f295a00, rc 0) 00000100:00100000:2.0:1787782727.991025:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922370432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (3333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782727.991031:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787782727.991089:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922370432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782727.991120:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b6370d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6370e0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782727.991128:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b6370d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b6370e0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782727.991202:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922370560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782727.991231:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782727.991257:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3108ac1600 going to sleep for 11 seconds 00000100:00100000:2.0:1787782727.991269:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922370560 00000100:00100000:2.0:1787782727.991273:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922370560 00000100:00100000:2.0:1787782727.991293:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787782727.991303:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922370560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782727.993287:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922370560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1979us (2050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782727.993298:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787782727.995174:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922370560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782727.995248:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922370688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782727.995311:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782727.995350:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3134015300 going to sleep for 11 seconds 00000100:00100000:0.0:1787782727.995367:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922370688 00000100:00100000:0.0:1787782727.995372:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922370688 00000100:00100000:0.0:1787782727.996057:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787782727.996068:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922370688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782727.996300:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922370688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 233us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782727.996307:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787782727.996363:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922370688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787782727.999608:0:8548:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8548:1874625922370816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787782727.999695:0:8548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782727.999748:0:8548:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312a249c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782727.999807:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922370816 00000100:00100000:0.0:1787782727.999814:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922370816 00000100:00100000:0.0:1787782727.999864:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787782727.999875:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:8548:x1874625922370816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782728.000086:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:8548:x1874625922370816:12345-0@lo:502:llog_process_th.0 Request processed in 213us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782728.000124:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787782728.001127:0:8548:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8548:1874625922370816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787782728.001161:0:8548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782728.001171:0:8548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782728.001174:0:8548:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787782728.001182:0:8548:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c311846c800 00000020:00000080:1.0:1787782728.001185:0:8548:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787782728.001276:0:8548:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8548:1874625922370944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787782728.001323:0:8548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782728.001356:0:8548:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3104d66f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782728.001972:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922370944 00000100:00100000:0.0:1787782728.001978:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922370944 00000100:00100000:0.0:1787782728.002072:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787782728.002082:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:8548:x1874625922370944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782728.002794:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:8548:x1874625922370944:12345-0@lo:502:llog_process_th.0 Request processed in 712us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782728.002804:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787782728.003714:0:8548:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:8548:1874625922370944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787782728.003753:0:8548:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782728.003761:0:8548:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782728.003764:0:8548:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787782728.003769:0:8548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787782728.007229:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787782728.007267:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787782728.007279:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b6370d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6370e0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782728.007292:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b6370d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6370e0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782728.035235:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782728.211348:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782728.211441:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782728.211479:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782728.211496:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904515712 00000100:00100000:3.0:1787782728.211508:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904515712 00000100:00100000:0.0:1787782728.211512:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782728.211539:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904515968 00000100:00100000:0.0:1787782728.211543:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904515968 00000100:00100000:0.0:1787782728.211583:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904515840 00000100:00100000:3.0:1787782728.211584:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:0.0:1787782728.211588:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904515840 00000100:00100000:3.0:1787782728.211598:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2352:x1874625904515712:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782728.211616:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:0.0:1787782728.211625:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2351:x1874625904515968:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782728.211678:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904515584 00000100:00100000:1.0:1787782728.211683:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904515584 00000100:00100000:1.0:1787782728.211794:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 191 00000100:00100000:1.0:1787782728.211803:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2352:x1874625904515584:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782728.211870:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2351:x1874625904515968:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 247us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782728.211885:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:0.0:1787782728.211902:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:0.0:1787782728.211909:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2351:x1874625904515840:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782728.211918:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2352:x1874625904515712:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 322us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782728.211926:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:0.0:1787782728.211945:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2351:x1874625904515840:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 34us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782728.211952:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00080000:3.0:1787782728.211960:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787782728.211965:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787782728.211974:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782728.212302:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2352:x1874625904515584:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 499us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782728.212311:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 191 00010000:00010000:3.0:1787782729.057504:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782730.081620:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782730.340570:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f136940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922371072:0@lo:400:kworker.0 00000100:00100000:3.0:1787782730.340649:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782730.340706:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922371584:0@lo:400:kworker.0 00000100:00100000:3.0:1787782730.340734:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782730.340762:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787782730.340768:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f137840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922371200:0@lo:400:kworker.0 00000100:00100000:3.0:1787782730.340791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782730.340807:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922371712:0@lo:400:kworker.0 00000100:00100000:3.0:1787782730.340831:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782730.340860:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922371456:0@lo:400:kworker.0 00000100:00100000:3.0:1787782730.340882:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782730.340901:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787782730.340905:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f135680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625922371328:0@lo:400:kworker.0 00000100:00100000:3.0:1787782730.340925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782730.340964:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922371584 00000100:00100000:3.0:1787782730.340971:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922371584 00000100:00100000:3.0:1787782730.341023:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922371200 00000100:00100000:3.0:1787782730.341026:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922371200 00000100:00100000:3.0:1787782730.341039:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922371328 00000100:00100000:3.0:1787782730.341042:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922371328 00000100:00100000:3.0:1787782730.341059:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787782730.341067:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922371584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782730.341144:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922371584:12345-0@lo:400:kworker.0 Request processed in 77us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782730.341151:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787782730.341193:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787782730.341199:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922371200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782730.341231:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922371200:12345-0@lo:400:kworker.0 Request processed in 33us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782730.341237:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787782730.341248:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787782730.341254:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625922371328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782730.341284:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625922371328:12345-0@lo:400:kworker.0 Request processed in 31us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782730.341291:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787782730.341309:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922371712 00000100:00100000:3.0:1787782730.341312:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922371712 00000100:00100000:3.0:1787782730.341338:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922371456 00000100:00100000:3.0:1787782730.341341:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922371456 00000100:00100000:3.0:1787782730.341361:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787782730.341367:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922371712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782730.341398:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922371712:12345-0@lo:400:kworker.0 Request processed in 31us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782730.341404:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787782730.341414:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787782730.341420:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922371456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782730.341447:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922371456:12345-0@lo:400:kworker.0 Request processed in 27us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782730.341453:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787782730.341473:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787782730.341477:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787782730.341479:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782730.341528:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f135680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625922371328:0@lo:400:kworker.0 00010000:00080000:3.0:1787782730.341542:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f1370c0 x1874625922371456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782730.341552:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922371456:0@lo:400:kworker.0 00000100:00100000:2.0:1787782730.341562:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f137840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922371200:0@lo:400:kworker.0 00010000:00080000:2.0:1787782730.341572:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f134000 x1874625922371712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782730.341580:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922371712:0@lo:400:kworker.0 00000100:00100000:2.0:1787782730.341589:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922371584:0@lo:400:kworker.0 00000100:00100000:1.0:1787782730.342125:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922371072 00000100:00100000:1.0:1787782730.342131:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922371072 00000100:00100000:1.0:1787782730.342164:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787782730.342181:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31091ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922371072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782730.342238:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31091ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922371072:12345-0@lo:400:kworker.0 Request processed in 68us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782730.342244:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787782730.342336:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f136940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922371072:0@lo:400:kworker.0 00000100:00100000:0.0:1787782730.849490:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922371840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782730.849574:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782730.849767:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922371840 00000100:00100000:2.0:1787782730.849774:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922371840 00000100:00100000:2.0:1787782730.849829:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787782730.849838:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922371840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787782730.849875:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787782730.850274:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922371840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 437us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782730.850282:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787782730.866240:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31070fe580 x1874625922371840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782730.866275:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922371840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782730.866318:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782730.866332:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922371968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782730.866922:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782730.867057:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922371968 00000100:00100000:3.0:1787782730.867065:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922371968 00000100:00100000:3.0:1787782730.867152:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787782730.867163:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f136940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922371968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787782730.867265:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782730.867312:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f136940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922371968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782730.867319:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787782730.867585:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31345ff0c0 x1874625922371968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782730.867603:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922371968:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787782731.113270:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782732.129546:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782733.154523:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782733.333242:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782733.333301:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782733.333430:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904516096 00000100:00100000:0.0:1787782733.333442:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904516096 00000100:00100000:0.0:1787782733.333502:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 193 00000100:00100000:0.0:1787782733.333513:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31091b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2352:x1874625904516096:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782733.335483:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31091b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2352:x1874625904516096:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 1963us (2243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782733.335497:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 193 00000100:00100000:3.0:1787782733.336648:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782733.336752:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782733.338343:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904516224 00000100:00100000:2.0:1787782733.338355:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904516224 00000100:00100000:2.0:1787782733.338438:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:2.0:1787782733.338448:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2351:x1874625904516224:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782733.338539:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2351:x1874625904516224:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 92us (5237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782733.338546:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00080000:2.0:1787782733.338567:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782733.345492:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904516352 00000100:00100000:0.0:1787782733.345510:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904516352 00000100:00100000:0.0:1787782733.347374:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904516480 00000100:00100000:0.0:1787782733.347384:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904516480 00000100:00100000:2.0:1787782733.347503:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:2.0:1787782733.347515:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2352:x1874625904516352:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782733.347604:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2352:x1874625904516352:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 92us (10963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782733.347612:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00080000:3.0:1787782733.352813:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787782733.352825:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787782733.356445:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:0.0:1787782733.356465:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2351:x1874625904516480:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782733.356568:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2351:x1874625904516480:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 110us (19815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782733.356576:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000001:02000400:1.0:1787782733.424435:0:8814:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1787782734.177406:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782735.204938:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782735.457327:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f137840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922372352:0@lo:400:kworker.0 00000100:00100000:1.0:1787782735.457397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782735.457457:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782735.457464:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922372480:0@lo:400:kworker.0 00000100:00100000:2.0:1787782735.457477:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922372096:0@lo:400:kworker.0 00000100:00100000:1.0:1787782735.457491:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782735.457507:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782735.457529:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f135680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922372608:0@lo:400:kworker.0 00000100:00100000:1.0:1787782735.457532:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922372352 00000100:00100000:1.0:1787782735.457544:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922372352 00000100:00100000:2.0:1787782735.457549:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782735.457566:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787782735.457570:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922372224:0@lo:400:kworker.0 00000100:00100000:2.0:1787782735.457589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787782735.463654:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782735.464089:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922372736:0@lo:400:kworker.0 00000100:00100000:2.0:1787782735.464170:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782735.470141:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922372608 00000100:00100000:1.0:1787782735.470158:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922372608 00000100:00080000:1.0:1787782735.470241:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782735.470333:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922372224 00000100:00100000:1.0:1787782735.470337:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922372224 00000100:00100000:1.0:1787782735.470355:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787782735.470365:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f1343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922372352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782735.470477:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f1343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922372352:12345-0@lo:400:kworker.0 Request processed in 113us (13080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782735.470484:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787782735.470529:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f137840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922372352:0@lo:400:kworker.0 00000100:00100000:1.0:1787782735.470555:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787782735.470562:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922372608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782735.470902:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787782735.470912:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922372224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782735.472188:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922372608:12345-0@lo:400:kworker.0 Request processed in 1624us (14634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782735.472199:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787782735.473990:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922372096 00000100:00100000:3.0:1787782735.474001:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922372096 00000100:00100000:3.0:1787782735.474044:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787782735.474053:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31091b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922372096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782735.477246:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922372480 00000100:00100000:1.0:1787782735.477261:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922372480 00000100:00100000:1.0:1787782735.477332:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922372736 00000100:00100000:1.0:1787782735.477335:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922372736 00000100:00100000:1.0:1787782735.477361:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787782735.477370:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f1352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922372480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782735.477468:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f1352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922372480:12345-0@lo:400:kworker.0 Request processed in 100us (19976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782735.477475:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787782735.477491:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787782735.477497:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922372736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782735.477728:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922372224:12345-0@lo:400:kworker.0 Request processed in 6817us (20136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782735.477738:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787782735.477926:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922372224:0@lo:400:kworker.0 00000100:00100000:3.0:1787782735.477996:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31091b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922372096:12345-0@lo:400:kworker.0 Request processed in 3942us (20485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782735.478005:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787782735.479181:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922372736:12345-0@lo:400:kworker.0 Request processed in 1680us (15007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782735.479193:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787782735.479220:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787782735.479225:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787782735.479256:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f1370c0 x1874625922372480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782735.479269:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922372480:0@lo:400:kworker.0 00010000:00080000:0.0:1787782735.487616:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f1361c0 x1874625922372736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782751 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782735.487636:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922372736:0@lo:400:kworker.0 00000100:00100000:1.0:1787782735.487831:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922372096:0@lo:400:kworker.0 00000100:00100000:1.0:1787782735.487845:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f135680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922372608:0@lo:400:kworker.0 00000100:00100000:3.0:1787782735.969440:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f135680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922372864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782735.969512:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782735.970069:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922372992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782735.970118:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782735.970187:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922372864 00000100:00100000:0.0:1787782735.970195:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922372864 00000100:00100000:1.0:1787782735.970226:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922372992 00000100:00100000:1.0:1787782735.970231:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922372992 00000100:00100000:0.0:1787782735.970236:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787782735.970244:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922372864:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782735.970250:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787782735.970255:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922372992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787782735.970277:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00002000:00000024:0.0:1787782735.970277:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782735.970320:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922372992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782735.970327:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787782735.970368:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31070fed00 x1874625922372992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782735.970386:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922372992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782735.970739:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922372864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 494us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782735.970745:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787782735.970802:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f135680 x1874625922372864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782735.972188:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f135680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922372864:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787782736.225396:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782737.259349:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782738.275040:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782738.462890:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782738.462939:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782738.463041:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904516736 00000100:00100000:0.0:1787782738.463048:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904516608 00000100:00100000:2.0:1787782738.463052:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904516736 00000100:00100000:0.0:1787782738.463052:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904516608 00000100:00100000:0.0:1787782738.463129:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 195 00000100:00100000:2.0:1787782738.463135:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:0.0:1787782738.463139:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31091b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2349:x1874625904516608:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782738.463142:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904516736:12345-192.168.202.15@tcp:400:kworker.0 00000100:00080000:3.0:1787782738.463215:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782738.463351:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31091b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2349:x1874625904516608:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 213us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782738.463373:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 195 00000100:00100000:2.0:1787782738.478429:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904516736:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 15272us (15474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782738.478446:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:2.0:1787782738.478548:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782738.478631:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782738.478657:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904516864 00000100:00100000:2.0:1787782738.478677:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904516864 00000100:00100000:2.0:1787782738.478728:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904516992 00000100:00100000:2.0:1787782738.478731:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904516992 00000100:00100000:2.0:1787782738.478757:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:2.0:1787782738.478766:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2348:x1874625904516864:12345-192.168.202.15@tcp:9:kworker.0 00000020:00000080:2.0:1787782738.478802:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b63701c 00000100:00080000:2.0:1787782738.478812:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8c3133fc0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787782738.478848:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787782738.479183:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+2:2348:x1874625904516864:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 417us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782738.479191:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:2.0:1787782738.479205:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:2.0:1787782738.479211:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2348:x1874625904516992:12345-192.168.202.15@tcp:9:kworker.0 00000020:00000080:2.0:1787782738.479226:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b637023 00000100:00080000:2.0:1787782738.479231:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8c31342dd800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787782738.479253:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787782738.479445:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+2:2348:x1874625904516992:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 233us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782738.479461:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00010000:00010000:2.0:1787782738.479538:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787782738.479555:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787782738.479558:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787782738.479568:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782739.310412:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787782739.796566:0:9058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing yml_node 00010000:00010000:3.0:1787782740.329490:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782740.582192:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922373376:0@lo:400:kworker.0 00000100:00100000:2.0:1787782740.582268:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782740.582331:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787782740.582338:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922373504:0@lo:400:kworker.0 00000100:00100000:2.0:1787782740.582364:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782740.582398:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922373248:0@lo:400:kworker.0 00000100:00100000:2.0:1787782740.582434:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782740.582459:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922373760:0@lo:400:kworker.0 00000100:00100000:2.0:1787782740.582478:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782740.582498:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787782740.582503:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922373120:0@lo:400:kworker.0 00000100:00100000:2.0:1787782740.582525:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782740.582543:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922373632:0@lo:400:kworker.0 00000100:00100000:2.0:1787782740.582559:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782740.582584:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922373376 00000100:00100000:2.0:1787782740.582590:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922373376 00000100:00100000:2.0:1787782740.582632:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922373248 00000100:00100000:2.0:1787782740.582634:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922373248 00000100:00100000:2.0:1787782740.582643:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922373632 00000100:00100000:2.0:1787782740.582645:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922373632 00000100:00100000:2.0:1787782740.582658:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787782740.582665:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922373376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782740.582716:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922373376:12345-0@lo:400:kworker.0 Request processed in 52us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782740.582723:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787782740.582738:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787782740.582743:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922373248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782740.582767:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922373248:12345-0@lo:400:kworker.0 Request processed in 24us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782740.582772:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787782740.582781:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787782740.582786:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922373632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782740.582805:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922373632:12345-0@lo:400:kworker.0 Request processed in 20us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782740.582810:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787782740.582824:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922373504 00000100:00100000:2.0:1787782740.582827:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922373504 00000100:00100000:2.0:1787782740.582845:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922373760 00000100:00100000:2.0:1787782740.582847:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922373760 00000100:00100000:2.0:1787782740.582861:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787782740.582866:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922373504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782740.582891:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922373504:12345-0@lo:400:kworker.0 Request processed in 25us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782740.582895:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787782740.582905:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787782740.582909:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922373760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782740.582928:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922373760:12345-0@lo:400:kworker.0 Request processed in 20us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782740.582943:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787782740.582961:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787782740.582964:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787782740.582967:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782740.583000:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922373632:0@lo:400:kworker.0 00000100:00100000:2.0:1787782740.583011:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922373248:0@lo:400:kworker.0 00010000:00080000:2.0:1787782740.583021:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31070fe580 x1874625922373760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782740.583030:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922373760:0@lo:400:kworker.0 00010000:00080000:2.0:1787782740.583059:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31070fd680 x1874625922373504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782740.583068:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922373504:0@lo:400:kworker.0 00000100:00100000:2.0:1787782740.583092:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922373376:0@lo:400:kworker.0 00000100:00100000:2.0:1787782740.585321:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922373120 00000100:00100000:2.0:1787782740.585335:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922373120 00000100:00100000:2.0:1787782740.585386:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787782740.585395:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922373120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782740.585477:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922373120:12345-0@lo:400:kworker.0 Request processed in 83us (2949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782740.585484:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787782740.585537:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922373120:0@lo:400:kworker.0 00000100:00100000:1.0:1787782741.100756:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922373888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782741.100850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782741.100917:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782741.100925:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922374016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782741.100949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782741.101004:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922373888 00000100:00100000:1.0:1787782741.101012:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922373888 00000100:00100000:1.0:1787782741.101055:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922374016 00000100:00100000:1.0:1787782741.101058:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922374016 00000100:00100000:1.0:1787782741.101090:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787782741.101120:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922373888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787782741.101161:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782741.101205:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922373888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782741.101212:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787782741.101232:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787782741.101238:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f1370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922374016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782741.101256:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782741.101283:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f1370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922374016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782741.101289:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787782741.101332:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31340bfc00 x1874625922374016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782741.101352:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922374016:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787782741.101365:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f1361c0 x1874625922373888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782741.101374:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922373888:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787782741.157326:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e4b0e72-6952-496d-b228-ab2778cd786f 00000020:00000080:3.0:1787782741.157336:0:7650:0:(genops.c:885:class_export_put()) final put ffff8c31342dc800/6e4b0e72-6952-496d-b228-ab2778cd786f 00000020:00000080:3.0:1787782741.157365:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c31342dc800/6e4b0e72-6952-496d-b228-ab2778cd786f for lustre-OST0001 00000020:00000080:3.0:1787782741.157414:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c31342dd800 for lustre-OST0001 00010000:00010000:2.0:1787782741.348630:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782742.380145:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787782743.233916:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e4b0e72-6952-496d-b228-ab2778cd786f 00000020:00000080:0.0:1787782743.233925:0:6723:0:(genops.c:885:class_export_put()) final put ffff8c3133fc7000/6e4b0e72-6952-496d-b228-ab2778cd786f 00000020:00000080:2.0:1787782743.234005:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3133fc7000/6e4b0e72-6952-496d-b228-ab2778cd786f for lustre-OST0000 00000020:00000080:2.0:1787782743.234076:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3133fc0800 for lustre-OST0000 00010000:00010000:3.0:1787782743.393319:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782743.565444:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782743.566807:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904517120 00000100:00100000:0.0:1787782743.566820:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904517120 00000100:00100000:0.0:1787782743.566899:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 197 00000100:00100000:0.0:1787782743.566909:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2349:x1874625904517120:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782743.566996:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2349:x1874625904517120:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 88us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782743.567005:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 197 00000100:00100000:3.0:1787782743.571833:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782743.575270:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904517248 00000100:00100000:2.0:1787782743.575291:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904517248 00000100:00100000:2.0:1787782743.575494:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:2.0:1787782743.575505:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904517248:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782743.575628:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904517248:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 125us (3812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782743.575636:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00080000:0.0:1787782743.582792:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787782744.419660:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787782745.096741:0:9252:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.55 00010000:00010000:2.0:1787782745.441449:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782745.702492:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922374272:0@lo:400:kworker.0 00000100:00100000:0.0:1787782745.702560:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782745.702619:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922374784:0@lo:400:kworker.0 00000100:00100000:0.0:1787782745.702645:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782745.702677:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787782745.702683:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922374144:0@lo:400:kworker.0 00000100:00100000:0.0:1787782745.702710:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782745.702731:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922374656:0@lo:400:kworker.0 00000100:00100000:0.0:1787782745.702750:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782745.702773:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922374400:0@lo:400:kworker.0 00000100:00100000:0.0:1787782745.702805:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782745.702825:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787782745.702830:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922374528:0@lo:400:kworker.0 00000100:00100000:0.0:1787782745.702862:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782745.702994:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922374272 00000100:00100000:0.0:1787782745.703002:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922374272 00000100:00100000:0.0:1787782745.703056:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922374656 00000100:00100000:0.0:1787782745.703060:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922374656 00000100:00100000:0.0:1787782745.703082:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922374400 00000100:00100000:0.0:1787782745.703085:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922374400 00000100:00100000:0.0:1787782745.703125:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787782745.703134:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922374272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782745.703182:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922374272:12345-0@lo:400:kworker.0 Request processed in 49us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782745.703188:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787782745.703204:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787782745.703209:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922374656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782745.703233:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922374656:12345-0@lo:400:kworker.0 Request processed in 25us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782745.703239:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787782745.703248:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787782745.703253:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922374400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782745.703283:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922374400:12345-0@lo:400:kworker.0 Request processed in 30us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782745.703288:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787782745.703305:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922374784 00000100:00100000:0.0:1787782745.703308:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922374784 00000100:00100000:0.0:1787782745.703332:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922374528 00000100:00100000:0.0:1787782745.703334:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922374528 00000100:00100000:0.0:1787782745.703351:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787782745.703357:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922374784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782745.703393:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922374784:12345-0@lo:400:kworker.0 Request processed in 36us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782745.703399:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787782745.703410:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787782745.703416:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e88b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922374528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782745.703440:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e88b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922374528:12345-0@lo:400:kworker.0 Request processed in 25us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782745.703445:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787782745.703461:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922374144 00000100:00100000:0.0:1787782745.703464:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922374144 00000100:00100000:0.0:1787782745.703487:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787782745.703494:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922374144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782745.703536:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922374144:12345-0@lo:400:kworker.0 Request processed in 43us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782745.703541:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:0.0:1787782745.703575:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787782745.703578:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787782745.703581:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787782745.703613:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31345ff480 x1874625922374528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782745.703627:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922374528:0@lo:400:kworker.0 00000100:00100000:0.0:1787782745.703638:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922374400:0@lo:400:kworker.0 00000100:00100000:0.0:1787782745.703665:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922374144:0@lo:400:kworker.0 00000100:00100000:0.0:1787782745.703674:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922374656:0@lo:400:kworker.0 00000100:00100000:0.0:1787782745.703693:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922374272:0@lo:400:kworker.0 00010000:00080000:0.0:1787782745.703702:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31345fe580 x1874625922374784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782745.703709:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922374784:0@lo:400:kworker.0 00000100:00100000:1.0:1787782746.214608:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f137840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922375040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782746.214681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782746.215038:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787782746.215152:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922374912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782746.215181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782746.215219:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922375040 00000100:00100000:1.0:1787782746.215227:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922375040 00000100:00100000:1.0:1787782746.215268:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922374912 00000100:00100000:1.0:1787782746.215271:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922374912 00000100:00100000:1.0:1787782746.215289:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787782746.215297:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f136580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922375040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782746.215328:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782746.215381:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f136580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922375040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782746.215389:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787782746.215408:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787782746.215414:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f137c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922374912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787782746.215433:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782746.215460:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f137c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922374912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782746.215466:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787782746.215527:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f1361c0 x1874625922374912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782746.215549:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922374912:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787782746.215563:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f137840 x1874625922375040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782746.215576:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f137840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922375040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787782746.465263:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782747.489426:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782748.535379:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782748.682296:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782748.682583:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782748.682916:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904517504 00000100:00100000:1.0:1787782748.682929:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904517504 00000100:00100000:1.0:1787782748.683044:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:1.0:1787782748.683057:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2352:x1874625904517504:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782748.683191:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2352:x1874625904517504:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 137us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782748.683200:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00080000:3.0:1787782748.683210:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782748.687556:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904517376 00000100:00100000:0.0:1787782748.687577:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904517376 00000100:00100000:0.0:1787782748.687705:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 199 00000100:00100000:0.0:1787782748.687716:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2352:x1874625904517376:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782748.687825:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2352:x1874625904517376:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 110us (5539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782748.687833:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 199 00000001:02000400:0.0:1787782749.190582:0:9350:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.55 00010000:00010000:3.0:1787782749.544754:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782750.571389:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782750.819135:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922375424:0@lo:400:kworker.0 00000100:00100000:1.0:1787782750.819241:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782750.819333:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782750.819340:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922375552:0@lo:400:kworker.0 00000100:00100000:1.0:1787782750.819370:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782750.819527:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922375424 00000100:00100000:2.0:1787782750.819538:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922375424 00000100:00100000:2.0:1787782750.819622:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787782750.819635:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f137840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922375424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782750.819705:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f137840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922375424:12345-0@lo:400:kworker.0 Request processed in 74us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782750.819713:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787782750.819798:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922375296:0@lo:400:kworker.0 00000100:00100000:0.0:1787782750.819836:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782750.819873:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922375808:0@lo:400:kworker.0 00000100:00100000:0.0:1787782750.819899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782750.819947:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787782750.819954:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922375168:0@lo:400:kworker.0 00000100:00100000:0.0:1787782750.819996:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782750.820021:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922375680:0@lo:400:kworker.0 00000100:00100000:0.0:1787782750.820047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782750.820080:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922375552 00000100:00100000:0.0:1787782750.820084:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922375552 00000100:00100000:0.0:1787782750.820146:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922375808 00000100:00100000:0.0:1787782750.820168:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922375808 00000100:00100000:0.0:1787782750.820195:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787782750.820203:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f1361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922375552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782750.820241:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f1361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922375552:12345-0@lo:400:kworker.0 Request processed in 39us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782750.820248:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787782750.820261:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787782750.820267:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922375808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782750.820301:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922375808:12345-0@lo:400:kworker.0 Request processed in 35us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782750.820307:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787782750.820326:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922375296 00000100:00100000:0.0:1787782750.820329:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922375296 00000100:00100000:0.0:1787782750.820351:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922375680 00000100:00100000:0.0:1787782750.820354:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922375680 00000100:00100000:0.0:1787782750.820368:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787782750.820374:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922375296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782750.820407:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922375296:12345-0@lo:400:kworker.0 Request processed in 33us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782750.820413:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787782750.820423:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787782750.820429:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922375680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782750.820454:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922375680:12345-0@lo:400:kworker.0 Request processed in 26us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782750.820460:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787782750.820481:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922375168 00000100:00100000:0.0:1787782750.820484:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922375168 00000100:00100000:0.0:1787782750.820517:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787782750.820523:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922375168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782750.820556:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922375168:12345-0@lo:400:kworker.0 Request processed in 33us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782750.820563:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787782750.820636:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922375168:0@lo:400:kworker.0 00000100:00100000:0.0:1787782750.820653:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922375680:0@lo:400:kworker.0 00000100:00100000:0.0:1787782750.820662:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340be940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922375296:0@lo:400:kworker.0 00010000:00080000:0.0:1787782750.820675:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31340bde00 x1874625922375808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782750.820686:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922375808:0@lo:400:kworker.0 00000100:00080000:1.0:1787782750.820966:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787782750.820971:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782750.820974:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787782750.821012:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31340bda40 x1874625922375552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782750.821023:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922375552:0@lo:400:kworker.0 00000100:00100000:1.0:1787782750.821037:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922375424:0@lo:400:kworker.0 00000100:00100000:3.0:1787782751.329336:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787782751.329364:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3108268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922375936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782751.329434:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782751.329874:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922375936 00000100:00100000:1.0:1787782751.329881:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922375936 00000100:00100000:0.0:1787782751.329997:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787782751.330008:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922376064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782751.330038:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782751.335569:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922376064 00000100:00100000:1.0:1787782751.335586:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922376064 00000100:00100000:1.0:1787782751.335641:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787782751.335651:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108269e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922375936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787782751.335691:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782751.335772:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108269e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922375936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (6337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782751.335779:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787782751.335812:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787782751.335817:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922376064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782751.335836:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782751.335872:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922376064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (5833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782751.335877:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787782751.336381:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f137480 x1874625922376064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782751.336406:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922376064:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1787782751.336775:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3108268f00 x1874625922375936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782751.336791:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3108268f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922375936:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787782751.587286:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787782752.291823:0:9447:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.55 00010000:00010000:3.0:1787782752.609269:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782753.634066:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782753.811752:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782753.811809:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782753.812317:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904517632 00000100:00100000:0.0:1787782753.812328:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904517632 00000100:00100000:0.0:1787782753.812392:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 201 00000100:00100000:0.0:1787782753.812403:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2349:x1874625904517632:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782753.812493:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2349:x1874625904517632:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 91us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782753.812519:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 201 00000100:00100000:1.0:1787782753.822989:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904517760 00000100:00100000:1.0:1787782753.823005:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904517760 00000100:00100000:0.0:1787782753.823222:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:0.0:1787782753.823234:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904517760:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782753.823345:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904517760:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 114us (11535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782753.823353:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00080000:1.0:1787782753.823842:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787782754.670706:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787782754.970624:0:9497:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 26 18:19:12 EDT 2026 00010000:00010000:3.0:1787782755.681435:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782755.947337:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922376320:0@lo:400:kworker.0 00000100:00100000:0.0:1787782755.947464:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782755.947579:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922376832:0@lo:400:kworker.0 00000100:00100000:0.0:1787782755.947613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782755.947657:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787782755.947663:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922376192:0@lo:400:kworker.0 00000100:00100000:0.0:1787782755.947700:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782755.947725:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922376704:0@lo:400:kworker.0 00000100:00100000:0.0:1787782755.947935:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782755.947984:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922376448:0@lo:400:kworker.0 00000100:00100000:0.0:1787782755.948013:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782755.948037:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787782755.948042:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccdad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922376576:0@lo:400:kworker.0 00000100:00100000:2.0:1787782755.948149:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922376320 00000100:00100000:2.0:1787782755.948160:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922376320 00000100:00100000:2.0:1787782755.948226:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922376704 00000100:00100000:2.0:1787782755.948229:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922376704 00000100:00100000:2.0:1787782755.948260:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922376448 00000100:00100000:2.0:1787782755.948263:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922376448 00000100:00100000:2.0:1787782755.948300:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787782755.948310:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922376320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782755.948381:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922376320:12345-0@lo:400:kworker.0 Request processed in 72us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782755.948389:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787782755.948409:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787782755.948416:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922376704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782755.948447:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922376704:12345-0@lo:400:kworker.0 Request processed in 32us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782755.948452:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787782755.948465:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787782755.948471:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922376448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782755.949879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782755.949992:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922376832 00000100:00100000:0.0:1787782755.950001:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922376832 00000100:00100000:0.0:1787782755.950055:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922376576 00000100:00100000:0.0:1787782755.950082:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922376576 00000100:00100000:0.0:1787782755.950125:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787782755.950135:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922376832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782755.950190:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922376832:12345-0@lo:400:kworker.0 Request processed in 57us (2576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782755.950197:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787782755.950214:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787782755.950221:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922376576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782755.950255:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922376576:12345-0@lo:400:kworker.0 Request processed in 35us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782755.950261:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787782755.950282:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922376192 00000100:00100000:0.0:1787782755.950286:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922376192 00000100:00100000:0.0:1787782755.950313:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787782755.950319:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922376192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782755.950353:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922376192:12345-0@lo:400:kworker.0 Request processed in 34us (2653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782755.950359:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00080000:0.0:1787782755.950438:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c313ccdad00 x1874625922376576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782755.950457:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccdad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922376576:0@lo:400:kworker.0 00000100:00080000:0.0:1787782755.950619:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787782755.950625:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787782755.950628:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782755.952212:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922376448:12345-0@lo:400:kworker.0 Request processed in 3731us (4187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782755.952230:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787782755.952318:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922376192:0@lo:400:kworker.0 00000100:00100000:2.0:1787782755.952338:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922376704:0@lo:400:kworker.0 00000100:00100000:2.0:1787782755.952351:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922376320:0@lo:400:kworker.0 00010000:00080000:2.0:1787782755.952366:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c313ccd92c0 x1874625922376832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782755.952376:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922376832:0@lo:400:kworker.0 00000100:00100000:0.0:1787782755.954016:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccda580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922376448:0@lo:400:kworker.0 00000100:00100000:3.0:1787782756.456317:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787782756.456351:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3108268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922376960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782756.456449:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782756.456556:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922376960 00000100:00100000:3.0:1787782756.456567:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922376960 00000100:00100000:3.0:1787782756.456630:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787782756.456641:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108268b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922376960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787782756.456690:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782756.456745:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108268b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922376960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782756.456754:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787782756.456806:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3108268000 x1874625922376960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782756.456827:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3108268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922376960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782756.459630:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782756.459658:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922377088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782756.459764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782756.459841:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922377088 00000100:00100000:1.0:1787782756.459849:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922377088 00000100:00100000:1.0:1787782756.459906:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787782756.459917:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f389a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922377088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782756.459973:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782756.460027:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f389a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922377088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782756.460035:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787782756.460085:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f137480 x1874625922377088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782756.460131:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922377088:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787782756.717389:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782757.739344:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782758.757239:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782758.932926:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782758.932974:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782758.933005:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904517888 00000100:00100000:1.0:1787782758.933014:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904517888 00000100:00100000:1.0:1787782758.933074:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 203 00000100:00100000:1.0:1787782758.933085:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2350:x1874625904517888:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782758.933181:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2350:x1874625904517888:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 98us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782758.933190:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 203 00000100:00100000:3.0:1787782758.933558:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904518016 00000100:00100000:3.0:1787782758.933563:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904518016 00000100:00100000:3.0:1787782758.933610:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:3.0:1787782758.933618:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904518016:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782758.933677:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904518016:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 60us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782758.933683:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00080000:1.0:1787782758.933746:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787782759.778794:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782760.813467:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782761.057615:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922377344:0@lo:400:kworker.0 00000100:00100000:0.0:1787782761.057755:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782761.057854:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922377856:0@lo:400:kworker.0 00000100:00100000:0.0:1787782761.057884:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782761.057937:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787782761.057954:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922377216:0@lo:400:kworker.0 00000100:00100000:0.0:1787782761.057988:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782761.058011:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922377728:0@lo:400:kworker.0 00000100:00100000:0.0:1787782761.058034:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782761.058070:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922377856 00000100:00100000:0.0:1787782761.058079:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922377856 00000100:00100000:0.0:1787782761.058186:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787782761.058196:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccdad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922377856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782761.058257:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccdad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922377856:12345-0@lo:400:kworker.0 Request processed in 62us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782761.058265:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787782761.058292:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922377216 00000100:00100000:0.0:1787782761.058296:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922377216 00000100:00100000:0.0:1787782761.058324:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787782761.058331:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922377216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782761.058364:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922377216:12345-0@lo:400:kworker.0 Request processed in 33us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782761.058370:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787782761.058403:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922377344 00000100:00100000:0.0:1787782761.058408:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922377344 00000100:00100000:0.0:1787782761.058437:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922377728 00000100:00100000:0.0:1787782761.058441:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922377728 00000100:00100000:0.0:1787782761.058462:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787782761.058480:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922377344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782761.058513:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922377344:12345-0@lo:400:kworker.0 Request processed in 35us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782761.058520:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787782761.058533:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787782761.058538:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922377728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782761.058563:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922377728:12345-0@lo:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782761.058569:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787782761.058623:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922377216:0@lo:400:kworker.0 00000100:00100000:0.0:1787782761.058640:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922377728:0@lo:400:kworker.0 00000100:00100000:0.0:1787782761.058650:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922377344:0@lo:400:kworker.0 00010000:00080000:0.0:1787782761.058663:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31340be1c0 x1874625922377856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782761.058673:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922377856:0@lo:400:kworker.0 00000100:00100000:1.0:1787782761.063089:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922377472:0@lo:400:kworker.0 00000100:00100000:1.0:1787782761.063223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782761.063298:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782761.063318:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922377600:0@lo:400:kworker.0 00000100:00100000:1.0:1787782761.063349:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787782761.063391:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787782761.063400:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787782761.063429:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922377472 00000100:00100000:1.0:1787782761.063439:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922377472 00000100:00100000:1.0:1787782761.063512:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787782761.063523:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f389680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922377472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782761.065231:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f389680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922377472:12345-0@lo:400:kworker.0 Request processed in 1698us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782761.067175:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922377472:0@lo:400:kworker.0 00000100:00100000:1.0:1787782761.067656:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787782761.067715:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922377600 00000100:00100000:1.0:1787782761.067724:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922377600 00000100:00100000:1.0:1787782761.067785:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787782761.067808:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f135680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922377600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782761.067965:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f135680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922377600:12345-0@lo:400:kworker.0 Request processed in 160us (4614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782761.067973:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787782761.068019:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782761.068025:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787782761.068452:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31340bc000 x1874625922377600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782761.068468:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922377600:0@lo:400:kworker.0 00000100:00100000:1.0:1787782761.571270:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922377984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782761.571429:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782761.571570:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922377984 00000100:00100000:1.0:1787782761.571581:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922377984 00000100:00100000:1.0:1787782761.571638:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787782761.571646:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922377984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782761.571687:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782761.571731:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922377984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782761.571736:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787782761.571784:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f137480 x1874625922377984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782761.571812:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922377984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782761.576356:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31342fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922378112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782761.576459:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782761.576560:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922378112 00000100:00100000:1.0:1787782761.576572:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922378112 00000100:00100000:1.0:1787782761.576637:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787782761.576647:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922378112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787782761.576696:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782761.576752:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922378112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782761.576760:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787782761.576811:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31342fcf00 x1874625922378112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782761.576843:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31342fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922378112:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787782761.827528:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782762.857285:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782763.878408:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782764.044433:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782764.044470:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782764.044650:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904518272 00000100:00100000:2.0:1787782764.044659:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904518272 00000100:00100000:2.0:1787782764.044717:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:2.0:1787782764.044725:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2351:x1874625904518272:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782764.044791:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2351:x1874625904518272:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 67us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782764.044796:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00080000:1.0:1787782764.044946:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782764.050804:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904518144 00000100:00100000:3.0:1787782764.050820:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904518144 00000100:00100000:3.0:1787782764.050915:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 205 00000100:00100000:3.0:1787782764.050927:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2351:x1874625904518144:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782764.051022:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2351:x1874625904518144:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 97us (6549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782764.051029:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 205 00010000:00010000:2.0:1787782764.897401:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782765.921662:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782766.183496:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31342fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922378496:0@lo:400:kworker.0 00000100:00100000:1.0:1787782766.183574:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782766.183629:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782766.183636:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31342fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922378624:0@lo:400:kworker.0 00000100:00100000:1.0:1787782766.183662:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782766.183706:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922378496 00000100:00100000:1.0:1787782766.183727:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922378496 00000100:00100000:1.0:1787782766.183795:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787782766.183806:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922378496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782766.183872:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922378496:12345-0@lo:400:kworker.0 Request processed in 68us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782766.183880:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1787782766.183902:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782766.183935:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31342fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922378496:0@lo:400:kworker.0 00000100:00100000:2.0:1787782766.184216:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31342fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922378240:0@lo:400:kworker.0 00000100:00100000:2.0:1787782766.184252:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782766.184284:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31342fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922378752:0@lo:400:kworker.0 00000100:00100000:2.0:1787782766.184308:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782766.184328:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787782766.184334:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31342fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922378368:0@lo:400:kworker.0 00000100:00100000:2.0:1787782766.184355:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782766.184371:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31342fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922378880:0@lo:400:kworker.0 00000100:00100000:2.0:1787782766.184393:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782766.184416:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922378752 00000100:00100000:2.0:1787782766.184420:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922378752 00000100:00100000:2.0:1787782766.184451:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922378368 00000100:00100000:2.0:1787782766.184453:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922378368 00000100:00100000:2.0:1787782766.184470:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787782766.184476:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922378752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782766.184525:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922378752:12345-0@lo:400:kworker.0 Request processed in 49us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782766.184531:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787782766.184544:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787782766.184549:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922378368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782766.184570:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340be940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922378368:12345-0@lo:400:kworker.0 Request processed in 21us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782766.184574:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787782766.184601:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31342fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922378368:0@lo:400:kworker.0 00000100:00100000:2.0:1787782766.184609:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31342fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922378752:0@lo:400:kworker.0 00000100:00080000:2.0:1787782766.184625:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782766.184764:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922378624 00000100:00100000:0.0:1787782766.184768:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922378624 00000100:00100000:0.0:1787782766.184812:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922378880 00000100:00100000:0.0:1787782766.184814:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922378880 00000100:00100000:0.0:1787782766.184832:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787782766.184837:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922378624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782766.184887:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922378624:12345-0@lo:400:kworker.0 Request processed in 49us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782766.184901:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787782766.184914:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787782766.184920:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922378880:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787782766.186130:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787782766.186139:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787782766.186896:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922378880:12345-0@lo:400:kworker.0 Request processed in 1970us (2496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782766.186908:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787782766.187013:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31342fe580 x1874625922378624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782766.187027:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31342fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922378624:0@lo:400:kworker.0 00000100:00100000:1.0:1787782766.187297:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922378240 00000100:00100000:1.0:1787782766.187306:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922378240 00000100:00100000:1.0:1787782766.187361:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787782766.187371:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922378240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782766.187462:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922378240:12345-0@lo:400:kworker.0 Request processed in 93us (3210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782766.187468:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00010000:00080000:2.0:1787782766.187742:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31342fc3c0 x1874625922378880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782782 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782766.187754:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31342fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922378880:0@lo:400:kworker.0 00000100:00100000:2.0:1787782766.187764:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31342fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922378240:0@lo:400:kworker.0 00000100:00100000:1.0:1787782766.689318:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787782766.689348:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31342ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922379008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782766.689434:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782766.689507:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922379008 00000100:00100000:1.0:1787782766.689515:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922379008 00000100:00100000:1.0:1787782766.689564:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787782766.689573:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922379008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787782766.689612:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782766.689670:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922379008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782766.689678:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787782766.689734:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31342ffc00 x1874625922379008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782766.689753:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31342ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922379008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782766.689896:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310826ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922379136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782766.689924:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782766.689950:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922379136 00000100:00100000:3.0:1787782766.689953:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922379136 00000100:00100000:3.0:1787782766.689985:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787782766.689993:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31082683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922379136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782766.690012:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782766.690041:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31082683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922379136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782766.690047:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787782766.690084:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c310826ad00 x1874625922379136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782766.690115:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310826ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922379136:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787782766.945402:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782767.980894:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782768.993343:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782769.164495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782769.164724:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904518400 00000100:00100000:2.0:1787782769.164737:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904518400 00000100:00100000:2.0:1787782769.164810:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 207 00000100:00100000:2.0:1787782769.164831:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2349:x1874625904518400:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782769.168254:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2349:x1874625904518400:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 3410us (3752us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782769.168275:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 207 00000100:00100000:1.0:1787782769.181461:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782769.194380:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904518528 00000100:00100000:2.0:1787782769.194402:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904518528 00000100:00100000:2.0:1787782769.194495:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:2.0:1787782769.194507:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904518528:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782769.194638:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904518528:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 134us (13194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782769.194647:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00080000:1.0:1787782769.195560:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787782770.017904:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782771.050641:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782771.297488:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922379520:0@lo:400:kworker.0 00000100:00100000:0.0:1787782771.297606:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782771.297688:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787782771.297695:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922379648:0@lo:400:kworker.0 00000100:00100000:0.0:1787782771.297726:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782771.297772:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922379520 00000100:00100000:0.0:1787782771.297779:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922379520 00000100:00100000:0.0:1787782771.297868:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787782771.297880:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922379520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782771.297944:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922379520:12345-0@lo:400:kworker.0 Request processed in 65us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782771.297951:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787782771.297978:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922379648 00000100:00100000:0.0:1787782771.297991:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922379648 00000100:00100000:0.0:1787782771.298024:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787782771.298031:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922379648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782771.298063:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922379648:12345-0@lo:400:kworker.0 Request processed in 33us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782771.298069:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787782771.298143:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c313ccd8b40 x1874625922379648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782771.298161:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922379648:0@lo:400:kworker.0 00000100:00100000:0.0:1787782771.298171:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922379520:0@lo:400:kworker.0 00000100:00100000:3.0:1787782771.298303:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922379392:0@lo:400:kworker.0 00000100:00100000:3.0:1787782771.298335:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782771.298363:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922379904:0@lo:400:kworker.0 00000100:00100000:3.0:1787782771.298383:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782771.298408:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787782771.298413:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccdb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922379264:0@lo:400:kworker.0 00000100:00100000:3.0:1787782771.298454:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782771.298475:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccd8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922379776:0@lo:400:kworker.0 00000100:00100000:3.0:1787782771.298493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782771.298561:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922379904 00000100:00100000:3.0:1787782771.298565:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922379904 00000100:00100000:3.0:1787782771.298594:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787782771.298601:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108269680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922379904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782771.298635:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108269680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922379904:12345-0@lo:400:kworker.0 Request processed in 35us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782771.298641:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787782771.298658:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922379264 00000100:00100000:3.0:1787782771.298661:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922379264 00000100:00100000:3.0:1787782771.298687:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787782771.298693:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922379264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782771.298719:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922379264:12345-0@lo:400:kworker.0 Request processed in 27us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782771.298732:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787782771.298761:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922379392 00000100:00100000:3.0:1787782771.298765:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922379392 00000100:00100000:3.0:1787782771.298784:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922379776 00000100:00100000:3.0:1787782771.298786:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922379776 00000100:00100000:3.0:1787782771.298811:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787782771.298818:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31082692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922379392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782771.298847:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31082692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922379392:12345-0@lo:400:kworker.0 Request processed in 30us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782771.298852:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787782771.298862:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787782771.298866:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310826bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922379776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782771.298885:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310826bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922379776:12345-0@lo:400:kworker.0 Request processed in 19us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782771.298890:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787782771.298936:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccdb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922379264:0@lo:400:kworker.0 00000100:00100000:3.0:1787782771.298947:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccd8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922379776:0@lo:400:kworker.0 00000100:00100000:3.0:1787782771.298956:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922379392:0@lo:400:kworker.0 00010000:00080000:3.0:1787782771.298967:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c313ccd9e00 x1874625922379904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782787 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782771.298977:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccd9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922379904:0@lo:400:kworker.0 00000100:00080000:1.0:1787782771.299145:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787782771.299151:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782771.299154:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782771.811555:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31342ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922380032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782771.811673:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782771.812048:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310826b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922380160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787782771.812090:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782771.812205:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922380032 00000100:00100000:1.0:1787782771.812216:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922380032 00000100:00100000:1.0:1787782771.812296:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922380160 00000100:00100000:1.0:1787782771.812299:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922380160 00000100:00100000:1.0:1787782771.812345:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787782771.812354:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922380032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782771.812403:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782771.812462:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922380032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782771.812471:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787782771.812488:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787782771.812494:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922380160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787782771.812518:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782771.812555:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922380160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782771.812561:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787782771.812607:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c310826b840 x1874625922380160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782771.812629:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310826b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922380160:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787782771.813240:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31342ffc00 x1874625922380032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782771.813281:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31342ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922380032:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787782772.068058:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782773.089329:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782774.116270:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782774.283592:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782774.283714:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904518656 00000100:00100000:2.0:1787782774.283728:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904518656 00000100:00100000:2.0:1787782774.283802:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 209 00000100:00100000:2.0:1787782774.283813:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2352:x1874625904518656:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782774.284904:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2352:x1874625904518656:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 1081us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782774.284919:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 209 00000100:00100000:0.0:1787782774.288977:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782774.289502:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904518784 00000100:00100000:3.0:1787782774.289516:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904518784 00000100:00100000:3.0:1787782774.289632:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:3.0:1787782774.289645:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2351:x1874625904518784:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782774.289768:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2351:x1874625904518784:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 125us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782774.289788:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00080000:3.0:1787782774.289819:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787782774.308917:0:10127:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 18:19:32 (1787782772) === 00000100:00100000:2.0:1787782774.852860:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782774.855778:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904518912 00000100:00100000:3.0:1787782774.855801:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904518912 00000100:00100000:3.0:1787782774.855918:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 210 00000100:00100000:3.0:1787782774.855930:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+10:8135:x1874625904518912:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787782774.855954:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782774.855979:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31013a1200/0x6d98ed19b6370e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e5228 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782774.856018:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a1200/0x6d98ed19b6370e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5228 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782774.856031:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31013a1200/0x6d98ed19b6370e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5228 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782774.856041:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1200, rc 0) 00000100:00100000:3.0:1787782774.856186:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+11:8135:x1874625904518912:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 258us (3348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782774.856195:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 210 00000100:00100000:3.0:1787782774.870652:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782774.870785:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904519040 00000100:00100000:0.0:1787782774.870799:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904519040 00000100:00100000:0.0:1787782774.870885:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 211 00000100:00100000:0.0:1787782774.870898:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+11:8135:x1874625904519040:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787782774.871374:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+11:8135:x1874625904519040:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 476us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782774.871395:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 211 00000100:00100000:1.0:1787782774.887405:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782774.887462:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904519168 00000100:00100000:1.0:1787782774.887476:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904519168 00000100:00100000:1.0:1787782774.887561:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 212 00000100:00100000:1.0:1787782774.887573:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+11:8135:x1874625904519168:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787782774.887919:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+11:8135:x1874625904519168:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 348us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782774.887929:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 212 00000100:00100000:1.0:1787782774.904348:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782774.905174:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904519296 00000100:00100000:3.0:1787782774.905199:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904519296 00000100:00100000:3.0:1787782774.905281:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 213 00000100:00100000:3.0:1787782774.905304:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+11:8139:x1874625904519296:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787782774.905704:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+11:8139:x1874625904519296:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 401us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782774.905712:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 213 00000100:00100000:1.0:1787782774.948037:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782774.950826:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904519424 00000100:00100000:2.0:1787782774.950873:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904519424 00000100:00100000:2.0:1787782774.950985:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 214 00000100:00100000:2.0:1787782774.950998:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+11:8139:x1874625904519424:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787782774.951829:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+11:8139:x1874625904519424:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 827us (3802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782774.951841:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 214 00000100:00100000:0.0:1787782774.978482:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782774.980838:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904519552 00000100:00100000:1.0:1787782774.980858:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904519552 00000100:00100000:1.0:1787782774.980942:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 215 00000100:00100000:1.0:1787782774.980954:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+11:8135:x1874625904519552:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787782774.980979:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782774.981004:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31421fda00/0x6d98ed19b6370ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e5252 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782774.981043:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31421fda00/0x6d98ed19b6370ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5252 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782774.981057:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31421fda00/0x6d98ed19b6370ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5252 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782774.981066:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31421fda00, rc 0) 00000100:00100000:1.0:1787782774.981213:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+12:8135:x1874625904519552:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 261us (2750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782774.981219:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 215 00000100:00100000:1.0:1787782774.987643:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782774.987836:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904519680 00000100:00100000:2.0:1787782774.987867:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904519680 00000100:00100000:2.0:1787782774.987938:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 216 00000100:00100000:2.0:1787782774.987951:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+12:8135:x1874625904519680:12345-192.168.202.15@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787782774.987993:0:5844:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787782774.988015:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787782774.988019:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787782774.988023:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787782774.988025:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787782774.993877:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+12:8135:x1874625904519680:12345-192.168.202.15@tcp:256:mount.lustre.0 Request processed in 5908us (6240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782774.993898:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 216 00000100:00100000:0.0:1787782775.001528:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782775.001692:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904519808 00000100:00100000:3.0:1787782775.001714:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904519808 00000100:00100000:3.0:1787782775.001793:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 217 00000100:00100000:3.0:1787782775.001805:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+12:8135:x1874625904519808:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787782775.001829:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782775.001851:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31013a1600/0x6d98ed19b6370f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e5259 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782775.001889:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a1600/0x6d98ed19b6370f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5259 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782775.001903:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31013a1600/0x6d98ed19b6370f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5259 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782775.001915:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1600, rc 0) 00000100:00100000:3.0:1787782775.001995:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:8135:x1874625904519808:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 193us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782775.002004:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 217 00000100:00100000:2.0:1787782775.025410:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782775.025536:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904519936 00000100:00100000:1.0:1787782775.025549:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904519936 00000100:00100000:1.0:1787782775.025626:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 218 00000100:00100000:1.0:1787782775.025816:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:8135:x1874625904519936:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787782775.035997:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:8135:x1874625904519936:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 10167us (10585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782775.036017:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 218 00000100:00100000:2.0:1787782775.043360:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782775.043478:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904520064 00000100:00100000:1.0:1787782775.043491:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904520064 00000100:00100000:1.0:1787782775.043562:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 219 00000100:00100000:1.0:1787782775.043574:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:8135:x1874625904520064:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787782775.043901:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:8135:x1874625904520064:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 327us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782775.043914:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 219 00000100:00100000:1.0:1787782775.047435:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782775.048538:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904520192 00000100:00100000:0.0:1787782775.048556:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904520192 00000100:00100000:0.0:1787782775.048644:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 220 00000100:00100000:0.0:1787782775.048656:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:8142:x1874625904520192:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787782775.049043:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:8142:x1874625904520192:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 388us (1624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782775.049053:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 220 00000100:00100000:2.0:1787782775.066325:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782775.066753:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904520320 00000100:00100000:1.0:1787782775.066778:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904520320 00000100:00100000:1.0:1787782775.066859:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 221 00000100:00100000:1.0:1787782775.066871:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:8142:x1874625904520320:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787782775.067260:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:8142:x1874625904520320:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 390us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782775.067273:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 221 00000100:00100000:2.0:1787782775.085022:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782775.085153:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904520448 00000100:00100000:3.0:1787782775.085167:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904520448 00000100:00100000:3.0:1787782775.085232:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:3.0:1787782775.085242:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1874625904520448:12345-192.168.202.15@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787782775.085281:0:5853:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 28cc7fcc-b12d-4e30-832a-e0699e918bd2@192.168.202.15@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1787782775.085344:0:5853:0:(genops.c:1385:class_connect()) connect: client 28cc7fcc-b12d-4e30-832a-e0699e918bd2, cookie 0x6d98ed19b6370fc 00000004:00100000:3.0:1787782775.085388:0:5853:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787782775.085746:0:5853:0:(import.c:65:import_set_state_nolock()) ffff8c3133fc1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787782775.085856:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:2348:x1874625904520448:12345-192.168.202.15@tcp:38:mount.lustre.0 Request processed in 613us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782775.085864:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:2.0:1787782775.106858:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782775.106976:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782775.107084:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904520576 00000100:00100000:0.0:1787782775.107128:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904520576 00000100:00100000:0.0:1787782775.107225:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904520704 00000100:00100000:0.0:1787782775.107229:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904520704 00000100:00100000:0.0:1787782775.107257:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:0.0:1787782775.107268:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28cc7fcc-b12d-4e30-832a-e0699e918bd2+7:0:x1874625904520576:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787782775.107336:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787782775.107451:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28cc7fcc-b12d-4e30-832a-e0699e918bd2+7:0:x1874625904520576:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 185us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782775.107459:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:0.0:1787782775.107481:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:0.0:1787782775.107488:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:8135:x1874625904520704:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787782775.107519:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787782775.107545:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:8135:x1874625904520704:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 58us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782775.107551:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00080000:1.0:1787782775.107976:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782775.110883:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782775.111051:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904520832 00000100:00100000:0.0:1787782775.111064:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904520832 00000100:00100000:0.0:1787782775.111389:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:0.0:1787782775.111402:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:8135:x1874625904520832:12345-192.168.202.15@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787782775.111521:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:8135:x1874625904520832:12345-192.168.202.15@tcp:40:mount.lustre.0 Request processed in 120us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782775.111529:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:3.0:1787782775.114816:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782775.114876:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782775.114915:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782775.114953:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904520960 00000100:00100000:3.0:1787782775.114966:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904520960 00000100:00100000:3.0:1787782775.115013:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904521088 00000100:00100000:3.0:1787782775.115016:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904521088 00000100:00100000:3.0:1787782775.115035:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787782775.115045:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310826a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1874625904520960:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787782775.115093:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 28cc7fcc-b12d-4e30-832a-e0699e918bd2@192.168.202.15@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1787782775.115180:0:6697:0:(genops.c:1385:class_connect()) connect: client 28cc7fcc-b12d-4e30-832a-e0699e918bd2, cookie 0x6d98ed19b637103 00002000:00100000:3.0:1787782775.115197:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 28cc7fcc-b12d-4e30-832a-e0699e918bd2/ffff8c3133fc2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113937 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787782775.115234:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787782775.115535:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787782775.115574:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8c3133fc6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787782775.115664:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310826a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:2348:x1874625904520960:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 617us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782775.115673:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787782775.115697:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:3.0:1787782775.115702:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310826b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1874625904521088:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787782775.115741:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 28cc7fcc-b12d-4e30-832a-e0699e918bd2@192.168.202.15@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1787782775.115759:0:6697:0:(genops.c:1385:class_connect()) connect: client 28cc7fcc-b12d-4e30-832a-e0699e918bd2, cookie 0x6d98ed19b63710a 00002000:00100000:3.0:1787782775.115765:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 28cc7fcc-b12d-4e30-832a-e0699e918bd2/ffff8c3133fc7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113937 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787782775.115804:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787782775.115940:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787782775.115956:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8c3133fc2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787782775.115982:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310826b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:2348:x1874625904521088:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 279us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782775.115989:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:1.0:1787782775.116261:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904521216 00000100:00100000:1.0:1787782775.116268:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904521216 00000100:00100000:1.0:1787782775.116320:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:1.0:1787782775.116328:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310826a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:8135:x1874625904521216:12345-192.168.202.15@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787782775.116623:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787782775.116755:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310826a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:8135:x1874625904521216:12345-192.168.202.15@tcp:33:mount.lustre.0 Request processed in 427us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782775.116763:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00010000:00010000:3.0:1787782775.137349:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782776.166138:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782776.419298:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787782776.419331:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922380288:0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.419448:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782776.419547:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922380288 00000100:00100000:0.0:1787782776.419557:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922380288 00000100:00100000:0.0:1787782776.419627:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787782776.419638:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922380288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.419707:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922380288:12345-0@lo:400:kworker.0 Request processed in 70us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782776.419716:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787782776.419804:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922380288:0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.419850:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922380416:0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.419884:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782776.419941:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922380416 00000100:00100000:0.0:1787782776.419946:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922380416 00000100:00100000:0.0:1787782776.419979:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787782776.419987:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922380416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.420027:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922380416:12345-0@lo:400:kworker.0 Request processed in 41us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782776.420033:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787782776.420061:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922380416:0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.420134:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922380544:0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.420161:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782776.420211:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccd8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922380672:0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.420242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782776.420297:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922380672 00000100:00100000:0.0:1787782776.420301:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922380672 00000100:00100000:0.0:1787782776.420344:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787782776.420350:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922380672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.420386:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922380672:12345-0@lo:400:kworker.0 Request processed in 37us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782776.420393:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787782776.420412:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787782776.420445:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c313ccd8780 x1874625922380672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782776.420458:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccd8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922380672:0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.420613:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787782776.420621:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccd8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922380800:0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.420669:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782776.420706:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922380544 00000100:00100000:0.0:1787782776.420709:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922380544 00000100:00100000:0.0:1787782776.420737:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922380800 00000100:00100000:0.0:1787782776.420740:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922380800 00000100:00100000:0.0:1787782776.420772:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787782776.420780:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922380544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.420819:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922380544:12345-0@lo:400:kworker.0 Request processed in 40us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782776.420825:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787782776.420837:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787782776.420844:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eed9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922380800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.420874:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eed9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922380800:12345-0@lo:400:kworker.0 Request processed in 31us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782776.420880:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1787782776.420894:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782776.420909:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922380544:0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.420931:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccd8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922380800:0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.420956:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eedbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922380928:0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.420978:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782776.421007:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922380928 00000100:00100000:0.0:1787782776.421011:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922380928 00000100:00100000:0.0:1787782776.421044:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787782776.421050:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eedb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922380928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782776.421084:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eedb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922380928:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782776.421090:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787782776.421137:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787782776.421153:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312eedbc00 x1874625922380928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782776.421163:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eedbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922380928:0@lo:400:kworker.0 00000100:00100000:3.0:1787782776.930286:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310826ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922381056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782776.930405:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782776.930524:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922381056 00000100:00100000:3.0:1787782776.930534:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922381056 00000100:00100000:3.0:1787782776.930591:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787782776.930602:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310826a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922381056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787782776.930659:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782776.930713:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310826a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922381056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782776.930720:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787782776.931341:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c310826ad00 x1874625922381056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782776.931366:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310826ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922381056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782776.936059:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310826ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922381184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782776.936202:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782776.936292:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922381184 00000100:00100000:3.0:1787782776.936304:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922381184 00000100:00100000:3.0:1787782776.936378:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787782776.936389:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108268780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922381184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782776.936441:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782776.936496:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108268780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922381184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782776.936504:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787782776.936554:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c310826ad00 x1874625922381184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782776.936579:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310826ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922381184:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787782777.100494:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28cc7fcc-b12d-4e30-832a-e0699e918bd2 00010000:00010000:0.0:1787782777.201784:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787782778.009257:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 28cc7fcc-b12d-4e30-832a-e0699e918bd2 00010000:00010000:0.0:1787782778.218185:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787782779.114644:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28cc7fcc-b12d-4e30-832a-e0699e918bd2 00010000:00010000:0.0:1787782779.233391:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782780.257645:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782780.430733:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782780.430796:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782780.431453:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782780.431482:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782780.431555:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904521856 00000100:00100000:2.0:1787782780.431568:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904521856 00000100:00100000:2.0:1787782780.431660:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:2.0:1787782780.431673:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310826b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904521856:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782780.431791:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310826b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904521856:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 120us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782780.431801:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00080000:2.0:1787782780.431831:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787782780.436230:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904521344 00000100:00100000:0.0:1787782780.436252:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904521344 00000100:00100000:0.0:1787782780.436363:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 223 00000100:00100000:0.0:1787782780.436376:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2349:x1874625904521344:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782780.436495:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2349:x1874625904521344:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 122us (5792us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782780.436503:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 223 00000100:00100000:2.0:1787782780.438711:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782780.439306:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904521728 00000100:00100000:3.0:1787782780.439322:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904521728 00000100:00100000:3.0:1787782780.439411:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:3.0:1787782780.439423:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c7ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904521728:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782780.439515:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c7ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904521728:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 93us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782780.439523:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00080000:2.0:1787782780.445779:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782780.446932:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904521600 00000100:00100000:1.0:1787782780.446949:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904521600 00000100:00100000:1.0:1787782780.447083:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904521472 00000100:00100000:1.0:1787782780.447088:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904521472 00000100:00100000:3.0:1787782780.447242:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00100000:3.0:1787782780.447258:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310826b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904521600:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782780.447401:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310826b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904521600:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 146us (16603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782780.447410:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00080000:2.0:1787782780.448250:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782780.448371:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:1.0:1787782780.448384:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108268f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904521472:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782780.448467:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108268f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904521472:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 87us (16983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782780.448475:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 72 00010000:00010000:0.0:1787782781.282079:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782781.538327:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eed9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922381568:0@lo:400:kworker.0 00000100:00100000:1.0:1787782781.538338:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eeda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922381440:0@lo:400:kworker.0 00000100:00100000:2.0:1787782781.538438:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eeda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922381312:0@lo:400:kworker.0 00000100:00100000:1.0:1787782781.542157:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782781.542288:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eedb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922381952:0@lo:400:kworker.0 00000100:00100000:1.0:1787782781.542350:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782781.542533:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922381952 00000100:00100000:1.0:1787782781.542543:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922381952 00000100:00100000:1.0:1787782781.542701:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787782781.542854:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922381440 00000100:00100000:0.0:1787782781.542859:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922381440 00000100:00100000:0.0:1787782781.542900:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787782781.542909:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922381440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782781.542991:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922381440:12345-0@lo:400:kworker.0 Request processed in 84us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782781.542998:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787782781.543054:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eeda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922381440:0@lo:400:kworker.0 00000100:00080000:0.0:1787782781.543121:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787782781.543157:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eed8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922381696:0@lo:400:kworker.0 00000100:00100000:0.0:1787782781.543213:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782781.543268:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922381696 00000100:00100000:0.0:1787782781.543273:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922381696 00000100:00100000:0.0:1787782781.543305:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787782781.543312:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eeda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922381696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782781.543352:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eeda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922381696:12345-0@lo:400:kworker.0 Request processed in 41us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782781.543358:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787782781.543387:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312eed8f00 x1874625922381696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782781.543399:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eed8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922381696:0@lo:400:kworker.0 00000100:00080000:0.0:1787782781.543413:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782781.543562:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922381952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782781.543687:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922381952:12345-0@lo:400:kworker.0 Request processed in 977us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782781.543695:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787782781.543873:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312eedb0c0 x1874625922381952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782781.543884:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eedb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922381952:0@lo:400:kworker.0 00000100:00100000:3.0:1787782781.548001:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782781.548269:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922381568 00000100:00100000:0.0:1787782781.548280:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922381568 00000100:00100000:2.0:1787782781.548302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782781.548375:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787782781.548391:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108269680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922381568:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787782781.548392:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782781.548488:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108269680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922381568:12345-0@lo:400:kworker.0 Request processed in 102us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782781.548495:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787782781.548618:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eed9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922381568:0@lo:400:kworker.0 00000100:00100000:2.0:1787782781.549307:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922381824:0@lo:400:kworker.0 00000100:00100000:3.0:1787782781.549314:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922381312 00000100:00100000:3.0:1787782781.549323:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922381312 00000100:00100000:2.0:1787782781.549368:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782781.549379:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787782781.549389:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922381312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782781.549539:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922381312:12345-0@lo:400:kworker.0 Request processed in 150us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782781.549555:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787782781.549574:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eeda940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922381312:0@lo:400:kworker.0 00000100:00100000:1.0:1787782781.556026:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922381824 00000100:00100000:1.0:1787782781.556045:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922381824 00000100:00080000:2.0:1787782781.556593:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782781.557850:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787782781.557889:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922381824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782781.558047:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922381824:12345-0@lo:400:kworker.0 Request processed in 163us (8679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782781.558056:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787782781.558365:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922381824:0@lo:400:kworker.0 00000100:00100000:3.0:1787782782.049772:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310826b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922382080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782782.049873:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782782.049945:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787782782.049952:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310826b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922382208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782782.049977:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782782.050018:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922382080 00000100:00100000:3.0:1787782782.050026:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922382080 00000100:00100000:3.0:1787782782.050079:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922382208 00000100:00100000:3.0:1787782782.050082:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922382208 00000100:00100000:3.0:1787782782.050129:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787782782.050139:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108269a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922382080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782782.050186:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782782.050256:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108269a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922382080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782782.050265:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787782782.050283:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787782782.050290:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922382208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787782782.050313:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782782.050341:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922382208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782782.050348:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787782782.050397:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c310826b0c0 x1874625922382208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782782.050419:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310826b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922382208:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787782782.050431:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c310826b840 x1874625922382080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782782.050443:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310826b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922382080:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787782782.306155:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787782782.814657:0:10326:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1787782783.329456:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782784.354802:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782785.380770:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782785.553919:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782785.553974:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782785.554013:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782785.554033:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782785.554303:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904522368 00000100:00100000:1.0:1787782785.554314:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904522368 00000100:00100000:1.0:1787782785.554382:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:1.0:1787782785.554392:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904522368:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782785.554463:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904522368:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 73us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782785.554471:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:0.0:1787782785.554575:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904522112 00000100:00100000:0.0:1787782785.554580:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904522112 00000100:00100000:0.0:1787782785.554641:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904522240 00000100:00100000:0.0:1787782785.554644:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904522240 00000100:00100000:0.0:1787782785.554668:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:0.0:1787782785.554686:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904522112:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782785.554720:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904522112:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 45us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782785.554727:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:0.0:1787782785.554740:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:0.0:1787782785.554746:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904522240:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782785.554771:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904522240:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 25us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782785.554777:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:2.0:1787782785.555228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782785.555256:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904521984 00000100:00100000:2.0:1787782785.555261:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904521984 00000100:00100000:2.0:1787782785.555293:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 225 00000100:00100000:2.0:1787782785.555300:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2349:x1874625904521984:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782785.555330:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2349:x1874625904521984:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 30us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782785.555336:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 225 00000100:00080000:2.0:1787782785.555367:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787782785.555373:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787782785.556024:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904522496 00000100:00100000:0.0:1787782785.556029:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904522496 00000100:00100000:0.0:1787782785.556079:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:0.0:1787782785.556088:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904522496:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782785.556147:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340be580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904522496:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 60us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782785.556154:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00080000:2.0:1787782785.557175:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787782786.408881:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782786.658299:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922382336:0@lo:400:kworker.0 00000100:00100000:1.0:1787782786.658369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782786.658452:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922382848:0@lo:400:kworker.0 00000100:00100000:1.0:1787782786.658481:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782786.658508:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787782786.658512:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922382592:0@lo:400:kworker.0 00000100:00100000:1.0:1787782786.658513:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922382464:0@lo:400:kworker.0 00000100:00100000:1.0:1787782786.658536:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782786.658541:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922382720:0@lo:400:kworker.0 00000100:00100000:1.0:1787782786.658553:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922382976:0@lo:400:kworker.0 00000100:00100000:3.0:1787782786.658566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782786.658812:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922382336 00000100:00100000:2.0:1787782786.658820:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922382336 00000100:00100000:3.0:1787782786.658834:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782786.658862:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787782786.658863:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922382720 00000100:00100000:3.0:1787782786.658867:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922382720 00000100:00100000:2.0:1787782786.658870:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922382336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782786.658903:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787782786.658909:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310826ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922382720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782786.658939:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310826ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922382720:12345-0@lo:400:kworker.0 Request processed in 31us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782786.658939:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922382336:12345-0@lo:400:kworker.0 Request processed in 69us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782786.658946:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787782786.658949:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787782786.658967:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922382848 00000100:00100000:3.0:1787782786.658971:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922382848 00000100:00100000:3.0:1787782786.659001:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922382464 00000100:00100000:3.0:1787782786.659003:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922382464 00000100:00100000:3.0:1787782786.659014:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922382592 00000100:00100000:3.0:1787782786.659015:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922382592 00000100:00100000:3.0:1787782786.659704:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787782786.659717:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922382848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782786.659751:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787782786.659759:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922382464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782786.659796:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922382464:12345-0@lo:400:kworker.0 Request processed in 38us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782786.659803:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787782786.659822:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787782786.659828:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310826b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922382592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782786.659860:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310826b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922382592:12345-0@lo:400:kworker.0 Request processed in 32us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782786.659866:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1787782786.660150:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787782786.660158:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782786.660172:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782786.660227:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922382336:0@lo:400:kworker.0 00000100:00100000:1.0:1787782786.660258:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922382464:0@lo:400:kworker.0 00000100:00100000:2.0:1787782786.660342:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922382976 00000100:00100000:2.0:1787782786.660348:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922382976 00000100:00100000:2.0:1787782786.660382:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787782786.660389:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922382976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782786.660423:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922382976:12345-0@lo:400:kworker.0 Request processed in 35us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782786.660430:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787782786.660492:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787782786.660519:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31345fc000 x1874625922382976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782786.660530:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922382976:0@lo:400:kworker.0 00000100:00100000:1.0:1787782786.660540:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922382848:0@lo:400:kworker.0 00000100:00100000:3.0:1787782786.660710:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922382848:12345-0@lo:400:kworker.0 Request processed in 996us (2227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782786.660717:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:3.0:1787782786.660754:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31345fcf00 x1874625922382720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782786.660762:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922382720:0@lo:400:kworker.0 00000100:00100000:3.0:1787782786.660781:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922382592:0@lo:400:kworker.0 00000100:00100000:2.0:1787782787.169374:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787782787.169398:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310826b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922383104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787782787.169465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782787.169625:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922383104 00000100:00100000:3.0:1787782787.169633:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922383104 00000100:00100000:3.0:1787782787.169687:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787782787.169696:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922383104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782787.169727:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782787.169774:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922383104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782787.169782:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787782787.169826:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c310826b0c0 x1874625922383104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782787.169861:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310826b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922383104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782787.170254:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eedb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922383232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782787.170283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782787.170413:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922383232 00000100:00100000:0.0:1787782787.170418:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922383232 00000100:00100000:0.0:1787782787.170453:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787782787.170461:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310826b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922383232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787782787.170482:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782787.170536:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310826b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922383232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782787.170550:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787782787.172764:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312eedb480 x1874625922383232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782787.172788:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eedb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922383232:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787782787.428490:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782788.449448:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782789.476135:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782790.497471:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782790.679191:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782790.679243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782790.679276:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782790.679302:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782790.679328:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782790.679471:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904522624 00000100:00100000:0.0:1787782790.679483:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904522624 00000100:00100000:0.0:1787782790.679543:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 227 00000100:00100000:0.0:1787782790.679554:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2349:x1874625904522624:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782790.679650:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2349:x1874625904522624:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 98us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782790.679658:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 227 00000100:00100000:0.0:1787782790.679691:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904522880 00000100:00100000:0.0:1787782790.679695:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904522880 00000100:00100000:0.0:1787782790.679728:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904522752 00000100:00100000:0.0:1787782790.679730:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904522752 00000100:00100000:0.0:1787782790.679764:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:0.0:1787782790.679771:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310826a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904522880:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782790.679802:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310826a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904522880:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 32us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782790.679808:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:0.0:1787782790.679820:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:0.0:1787782790.679827:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904522752:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782790.679849:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904522752:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 23us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782790.679855:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00080000:0.0:1787782790.679980:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782790.680512:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904523136 00000100:00100000:3.0:1787782790.680517:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904523136 00000100:00100000:3.0:1787782790.680571:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904523008 00000100:00100000:3.0:1787782790.680574:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904523008 00000100:00100000:3.0:1787782790.680599:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:3.0:1787782790.680606:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904523136:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782790.680737:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:1.0:1787782790.680754:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3112d79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904523008:12345-192.168.202.15@tcp:400:kworker.0 00000100:00080000:0.0:1787782790.680809:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787782790.680812:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787782790.680905:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904523136:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 299us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782790.680912:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:1.0:1787782790.688075:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3112d79680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904523008:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 7307us (8730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782790.688091:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 50 00010000:00010000:2.0:1787782791.521419:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782791.778164:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f38ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922383488:0@lo:400:kworker.0 00000100:00100000:0.0:1787782791.778237:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782791.778308:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922384000:0@lo:400:kworker.0 00000100:00100000:0.0:1787782791.778335:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782791.778369:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787782791.778375:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f38a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922383360:0@lo:400:kworker.0 00000100:00100000:0.0:1787782791.778401:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782791.778422:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922383872:0@lo:400:kworker.0 00000100:00100000:0.0:1787782791.778441:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782791.778469:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922384000 00000100:00100000:0.0:1787782791.778476:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922384000 00000100:00100000:0.0:1787782791.778543:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787782791.778552:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eed8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922384000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782791.778601:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eed8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922384000:12345-0@lo:400:kworker.0 Request processed in 50us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782791.778608:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787782791.778915:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922383360 00000100:00100000:0.0:1787782791.778920:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922383360 00000100:00100000:0.0:1787782791.778948:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787782791.778955:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922383360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782791.778987:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922383360:12345-0@lo:400:kworker.0 Request processed in 32us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782791.778992:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1787782791.779017:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922383488 00000100:00100000:0.0:1787782791.779020:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922383488 00000100:00100000:0.0:1787782791.779057:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922383872 00000100:00100000:0.0:1787782791.779060:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922383872 00000100:00100000:0.0:1787782791.779081:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787782791.779087:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eed8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922383488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782791.779156:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eed8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922383488:12345-0@lo:400:kworker.0 Request processed in 69us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782791.779162:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787782791.779173:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787782791.779178:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eeda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922383872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782791.779198:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eeda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922383872:12345-0@lo:400:kworker.0 Request processed in 21us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782791.779204:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1787782791.779216:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787782791.779220:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787782791.779253:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f38a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922383360:0@lo:400:kworker.0 00000100:00100000:0.0:1787782791.779264:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922383872:0@lo:400:kworker.0 00000100:00100000:0.0:1787782791.779271:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f38ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922383488:0@lo:400:kworker.0 00010000:00080000:0.0:1787782791.779281:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31410e7840 x1874625922384000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782791.779291:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922384000:0@lo:400:kworker.0 00000100:00100000:2.0:1787782791.779434:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922383616:0@lo:400:kworker.0 00000100:00100000:2.0:1787782791.779460:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782791.779494:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787782791.779500:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922383744:0@lo:400:kworker.0 00000100:00100000:2.0:1787782791.779518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782791.779541:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922383744 00000100:00100000:2.0:1787782791.779544:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922383744 00000100:00100000:2.0:1787782791.779571:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787782791.779577:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922383744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782791.779606:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922383744:12345-0@lo:400:kworker.0 Request processed in 30us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782791.779611:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1787782791.779648:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31410e6940 x1874625922383744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782791.779657:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922383744:0@lo:400:kworker.0 00000100:00100000:3.0:1787782791.779927:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922383616 00000100:00100000:3.0:1787782791.779931:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922383616 00000100:00100000:3.0:1787782791.779967:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787782791.779975:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922383616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782791.780017:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922383616:12345-0@lo:400:kworker.0 Request processed in 43us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782791.780023:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1787782791.780183:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787782791.780187:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787782791.780237:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922383616:0@lo:400:kworker.0 00000100:00100000:3.0:1787782792.289230:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787782792.289258:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922384128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782792.289324:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782792.289382:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922384128 00000100:00100000:3.0:1787782792.289389:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922384128 00000100:00100000:3.0:1787782792.289432:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787782792.289439:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922384128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782792.289473:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782792.289511:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922384128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782792.289518:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1787782792.289557:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31410e5680 x1874625922384128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782792.289575:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922384128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782792.290597:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787782792.290796:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eedad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922384256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782792.290842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782792.291785:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922384256 00000100:00100000:3.0:1787782792.291795:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922384256 00000100:00100000:3.0:1787782792.291846:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787782792.291855:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eed83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922384256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787782792.291897:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782792.291958:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eed83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922384256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782792.291965:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787782792.292005:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312eedad00 x1874625922384256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782792.292024:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eedad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922384256:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787782792.545284:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782793.570692:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782794.595561:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782795.622299:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782795.796715:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782795.796794:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782795.796825:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782795.796863:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904523264 00000100:00100000:0.0:1787782795.796873:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904523264 00000100:00100000:0.0:1787782795.796941:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 229 00000100:00100000:0.0:1787782795.796950:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2349:x1874625904523264:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782795.797018:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2349:x1874625904523264:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 69us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782795.797025:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 229 00000100:00100000:0.0:1787782795.797057:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904523392 00000100:00100000:0.0:1787782795.797061:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904523392 00000100:00100000:0.0:1787782795.797118:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904523520 00000100:00100000:0.0:1787782795.797122:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904523520 00000100:00100000:0.0:1787782795.797147:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:0.0:1787782795.797153:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eedad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904523392:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782795.797183:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eedad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904523392:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 30us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782795.797190:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:0.0:1787782795.797202:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:0.0:1787782795.797209:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904523520:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782795.797236:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904523520:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 28us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782795.797242:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00080000:0.0:1787782795.797368:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782795.800906:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782795.800958:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782795.800990:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904523648 00000100:00100000:0.0:1787782795.800998:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904523648 00000100:00100000:0.0:1787782795.801049:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904523776 00000100:00100000:0.0:1787782795.801053:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904523776 00000100:00100000:0.0:1787782795.801080:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:0.0:1787782795.801089:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eedb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2348:x1874625904523648:12345-192.168.202.15@tcp:9:kworker.0 00000020:00000080:0.0:1787782795.801170:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b637103 00000100:00080000:0.0:1787782795.801181:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8c3133fc6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787782795.801221:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787782795.801539:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eedb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+2:2348:x1874625904523648:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 450us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782795.801548:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:0.0:1787782795.801566:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:0.0:1787782795.801573:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eed8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2348:x1874625904523776:12345-192.168.202.15@tcp:9:kworker.0 00000020:00000080:0.0:1787782795.801595:0:6696:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b63710a 00000100:00080000:0.0:1787782795.801602:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8c3133fc2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787782795.801624:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787782795.801797:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eed8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+2:2348:x1874625904523776:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 224us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782795.801804:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00010000:00010000:0.0:1787782795.801830:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782795.801835:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787782795.801842:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787782795.801845:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787782796.644740:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782796.898353:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922384384:0@lo:400:kworker.0 00000100:00100000:2.0:1787782796.898439:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782796.898527:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922384384 00000100:00100000:2.0:1787782796.898533:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922384384 00000100:00100000:2.0:1787782796.898588:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787782796.898598:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922384384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782796.898648:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922384384:12345-0@lo:400:kworker.0 Request processed in 51us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782796.898670:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787782796.898724:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922384384:0@lo:400:kworker.0 00000100:00100000:3.0:1787782796.907930:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922384640:0@lo:400:kworker.0 00000100:00100000:3.0:1787782796.908023:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782796.908083:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922384640 00000100:00100000:3.0:1787782796.908091:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922384640 00000100:00100000:3.0:1787782796.908167:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787782796.908177:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922384640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782796.908232:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922384640:12345-0@lo:400:kworker.0 Request processed in 57us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782796.908238:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1787782796.908259:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782796.908288:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922384640:0@lo:400:kworker.0 00000100:00100000:3.0:1787782796.908321:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922384768:0@lo:400:kworker.0 00000100:00100000:3.0:1787782796.908349:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782796.908378:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922384768 00000100:00100000:3.0:1787782796.908382:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922384768 00000100:00100000:3.0:1787782796.908409:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787782796.908415:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922384768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782796.908450:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922384768:12345-0@lo:400:kworker.0 Request processed in 36us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782796.908456:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787782796.908469:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787782796.908489:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31410e43c0 x1874625922384768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782796.908499:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922384768:0@lo:400:kworker.0 00000100:00100000:3.0:1787782796.908554:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922384896:0@lo:400:kworker.0 00000100:00100000:3.0:1787782796.908591:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782796.908619:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787782796.908625:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922384512:0@lo:400:kworker.0 00000100:00100000:3.0:1787782796.908646:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782796.908660:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922385024:0@lo:400:kworker.0 00000100:00100000:3.0:1787782796.908680:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782796.908705:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922384896 00000100:00100000:3.0:1787782796.908708:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922384896 00000100:00100000:3.0:1787782796.908731:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922384512 00000100:00100000:3.0:1787782796.908734:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922384512 00000100:00100000:3.0:1787782796.908749:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787782796.908756:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922384896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782796.908790:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922384896:12345-0@lo:400:kworker.0 Request processed in 35us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782796.908795:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787782796.908806:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787782796.908812:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922384512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782796.908839:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922384512:12345-0@lo:400:kworker.0 Request processed in 28us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782796.908845:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787782796.908860:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922385024 00000100:00100000:3.0:1787782796.908863:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922385024 00000100:00100000:3.0:1787782796.908884:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787782796.908889:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922385024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782796.908916:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922385024:12345-0@lo:400:kworker.0 Request processed in 27us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782796.908922:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1787782796.908934:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787782796.908942:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782796.908963:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922384512:0@lo:400:kworker.0 00010000:00080000:3.0:1787782796.908973:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31410e4780 x1874625922385024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782796.908981:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922385024:0@lo:400:kworker.0 00000100:00100000:3.0:1787782796.908990:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922384896:0@lo:400:kworker.0 00000100:00100000:1.0:1787782797.409331:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922385152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782797.409395:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782797.409510:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922385152 00000100:00100000:3.0:1787782797.409519:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922385152 00000100:00100000:3.0:1787782797.409585:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787782797.409596:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922385152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782797.409626:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782797.409674:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922385152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782797.409679:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787782797.409712:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3119ef70c0 x1874625922385152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782797.409740:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922385152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787782797.409744:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922385280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787782797.409770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782797.409841:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922385280 00000100:00100000:3.0:1787782797.409845:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922385280 00000100:00100000:3.0:1787782797.409874:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787782797.409881:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922385280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787782797.409904:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782797.409953:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922385280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782797.409960:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787782797.410221:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312eed9e00 x1874625922385280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782797.410235:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eed9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922385280:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787782797.543996:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28cc7fcc-b12d-4e30-832a-e0699e918bd2 00000020:00000080:2.0:1787782797.544006:0:7650:0:(genops.c:885:class_export_put()) final put ffff8c3133fc7800/28cc7fcc-b12d-4e30-832a-e0699e918bd2 00000020:00000080:2.0:1787782797.544035:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3133fc7800/28cc7fcc-b12d-4e30-832a-e0699e918bd2 for lustre-OST0001 00000020:00000080:2.0:1787782797.544368:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3133fc2000 for lustre-OST0001 00010000:00010000:1.0:1787782797.666433:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782798.689252:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787782799.550567:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28cc7fcc-b12d-4e30-832a-e0699e918bd2 00000020:00000080:0.0:1787782799.550590:0:6723:0:(genops.c:885:class_export_put()) final put ffff8c3133fc2800/28cc7fcc-b12d-4e30-832a-e0699e918bd2 00000020:00000080:0.0:1787782799.550620:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3133fc2800/28cc7fcc-b12d-4e30-832a-e0699e918bd2 for lustre-OST0000 00000020:00000080:0.0:1787782799.550664:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3133fc6000 for lustre-OST0000 00010000:00010000:0.0:1787782799.715883:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782800.737394:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782800.913065:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782800.913161:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782800.913192:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782800.913345:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904524160 00000100:00100000:2.0:1787782800.913356:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904524160 00000100:00100000:2.0:1787782800.913415:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904524032 00000100:00100000:2.0:1787782800.913419:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904524032 00000100:00100000:2.0:1787782800.913444:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:2.0:1787782800.913464:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eeda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904524160:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782800.913553:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eeda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904524160:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 101us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782800.913561:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:2.0:1787782800.913578:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:2.0:1787782800.913584:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eed9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904524032:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782800.913609:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eed9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904524032:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782800.913630:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00080000:2.0:1787782800.913652:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782800.913913:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904523904 00000100:00100000:0.0:1787782800.913918:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904523904 00000100:00100000:0.0:1787782800.913970:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 231 00000100:00100000:0.0:1787782800.913977:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2349:x1874625904523904:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782800.914009:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2349:x1874625904523904:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 33us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782800.914016:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 231 00000001:02000400:3.0:1787782801.352562:0:11028:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787782801.762706:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782802.017437:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119ef5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922385408:0@lo:400:kworker.0 00000100:00100000:0.0:1787782802.017543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782802.017612:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922385920:0@lo:400:kworker.0 00000100:00100000:0.0:1787782802.017652:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782802.017679:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787782802.017685:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922385536:0@lo:400:kworker.0 00000100:00100000:0.0:1787782802.017707:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782802.017722:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922386048:0@lo:400:kworker.0 00000100:00100000:0.0:1787782802.017746:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782802.017779:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922386048 00000100:00100000:0.0:1787782802.017786:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922386048 00000100:00100000:0.0:1787782802.017854:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787782802.017863:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eed9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922386048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782802.017929:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eed9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922386048:12345-0@lo:400:kworker.0 Request processed in 67us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782802.017936:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1787782802.017989:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f3d6940 x1874625922386048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782802.018003:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922386048:0@lo:400:kworker.0 00000100:00100000:3.0:1787782802.018212:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922385408 00000100:00100000:3.0:1787782802.018218:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922385408 00000100:00100000:3.0:1787782802.018256:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787782802.018271:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922385408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782802.018312:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922385408:12345-0@lo:400:kworker.0 Request processed in 43us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782802.018319:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787782802.018404:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922385664:0@lo:400:kworker.0 00000100:00100000:2.0:1787782802.018436:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782802.018467:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787782802.018473:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922385792:0@lo:400:kworker.0 00000100:00100000:2.0:1787782802.018493:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782802.018523:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922385920 00000100:00100000:2.0:1787782802.018538:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922385920 00000100:00100000:2.0:1787782802.018565:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922385536 00000100:00100000:2.0:1787782802.018567:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922385536 00000100:00100000:2.0:1787782802.018577:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922385664 00000100:00100000:2.0:1787782802.018579:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922385664 00000100:00100000:2.0:1787782802.018590:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787782802.018596:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eedb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922385920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782802.018626:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eedb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922385920:12345-0@lo:400:kworker.0 Request processed in 30us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782802.018632:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787782802.018656:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787782802.018662:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eedbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922385536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782802.018689:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eedbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922385536:12345-0@lo:400:kworker.0 Request processed in 27us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782802.018695:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787782802.018705:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787782802.018711:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922385664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782802.018740:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922385664:12345-0@lo:400:kworker.0 Request processed in 29us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782802.018753:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1787782802.018773:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787782802.018777:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787782802.018786:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922385792 00000100:00100000:2.0:1787782802.018789:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922385792 00000100:00100000:2.0:1787782802.018815:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787782802.018821:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922385792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782802.018850:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922385792:12345-0@lo:400:kworker.0 Request processed in 29us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782802.018855:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1787782802.018871:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787782802.018890:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31410e4780 x1874625922385792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782802.018900:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922385792:0@lo:400:kworker.0 00000100:00100000:2.0:1787782802.018911:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922385664:0@lo:400:kworker.0 00000100:00100000:0.0:1787782802.019155:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119ef70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922385536:0@lo:400:kworker.0 00000100:00100000:0.0:1787782802.019165:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119ef5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922385408:0@lo:400:kworker.0 00000100:00100000:0.0:1787782802.019175:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922385920:0@lo:400:kworker.0 00000100:00100000:3.0:1787782802.531216:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787782802.531245:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922386176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782802.531330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782802.531406:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922386176 00000100:00100000:3.0:1787782802.531414:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922386176 00000100:00100000:3.0:1787782802.531461:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787782802.531470:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922386176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782802.531508:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782802.531566:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922386176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782802.531573:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787782802.531616:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f3d4f00 x1874625922386176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782802.531636:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922386176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782802.532259:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787782802.532270:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922386304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782802.532307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782802.532344:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922386304 00000100:00100000:3.0:1787782802.532349:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922386304 00000100:00100000:3.0:1787782802.532376:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787782802.532382:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922386304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787782802.532405:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782802.532452:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922386304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782802.532458:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787782802.532485:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f3d4f00 x1874625922386304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782802.532498:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922386304:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787782802.788119:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782803.810950:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782804.839031:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787782804.953419:0:11177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9c2c5650 20000000:00000080:0.0:1787782804.953640:0:11177:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c312efe8000 uarg=0000000000000000 20000000:01000000:0.0:1787782804.953680:0:11177:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787782804.953687:0:11177:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787782804.953691:0:11177:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787782804.957395:0:11178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1787782804.957708:0:11177:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787782804.968221:0:11177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787782804.968628:0:11177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c31421fce00/0x6d98ed19b637111 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782804.968665:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b6370b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5221 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782804.968674:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31421fc800/0x6d98ed19b6370c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6370bd expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782804.968681:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3141255200/0x6d98ed19b6370d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6370cb expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782804.968687:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c312f295a00/0x6d98ed19b6370e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6370d9 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782804.968695:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31013a1600/0x6d98ed19b6370f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5259 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782804.968704:0:11177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c31421fce00/0x6d98ed19b637111 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782804.968749:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31013a1600/0x6d98ed19b6370f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5259 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782804.968764:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c31013a1600/0x6d98ed19b6370f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5259 expref: 12 pid: 5845 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782804.968778:0:11177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31342fe580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874625922386432:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782804.968917:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c312f295a00/0x6d98ed19b6370e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b6370d9 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782804.968926:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c312f295a00/0x6d98ed19b6370e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b6370d9 expref: 18 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782804.968941:0:11177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31342fcf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874625922386560:0@lo:104: 00000100:00100000:1.0:1787782804.968984:0:11177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787782804.969026:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3141255200/0x6d98ed19b6370d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b6370cb expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782804.969035:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c3141255200/0x6d98ed19b6370d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b6370cb expref: 18 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782804.969044:0:11177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31342fe1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874625922386688:0@lo:104: 00000100:00100000:1.0:1787782804.969064:0:11177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787782804.969126:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31421fc800/0x6d98ed19b6370c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b6370bd expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782804.969134:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c31421fc800/0x6d98ed19b6370c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b6370bd expref: 18 pid: 5846 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782804.969142:0:11177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874625922386816:0@lo:104: 00000100:00100000:1.0:1787782804.969164:0:11177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787782804.969181:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b6370b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5221 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782804.969189:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b6370b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5221 expref: 12 pid: 5844 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782804.969196:0:11177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f134b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874625922386944:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782804.969219:0:11177:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782804.969296:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922386560 00000100:00100000:2.0:1787782804.969303:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922386560 00000100:00100000:2.0:1787782804.969342:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922386688 00000100:00100000:2.0:1787782804.969345:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922386688 00000100:00100000:2.0:1787782804.969356:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922386816 00000100:00100000:2.0:1787782804.969358:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922386816 00000100:00100000:2.0:1787782804.969371:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787782804.969379:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+5:11177:x1874625922386560:12345-0@lo:104: 00010000:00010000:2.0:1787782804.969391:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b6370d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b6370e0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969474:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787782804.969481:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+5:11177:x1874625922386560:12345-0@lo:104: Request processed in 102us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782804.969488:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787782804.969519:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787782804.969525:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+4:11177:x1874625922386688:12345-0@lo:104: 00010000:00010000:2.0:1787782804.969533:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31013a1a00/0x6d98ed19b6370cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b6370d2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969566:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787782804.969571:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+4:11177:x1874625922386688:12345-0@lo:104: Request processed in 46us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782804.969577:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787782804.969589:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787782804.969594:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+3:11177:x1874625922386816:12345-0@lo:104: 00010000:00010000:2.0:1787782804.969602:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c3141255c00/0x6d98ed19b6370bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b6370c4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969635:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787782804.969640:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+3:11177:x1874625922386816:12345-0@lo:104: Request processed in 46us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782804.969646:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787782804.969662:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787782804.969668:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b6370d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b6370e0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969675:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0600 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:2.0:1787782804.969684:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b6370d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b6370e0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969693:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b6370d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b6370e0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782804.969701:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b6370d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b6370e0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782804.969706:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787782804.969736:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b6370d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6370e0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969743:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782804.969763:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b6370d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6370e0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969771:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b6370d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6370e0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969786:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787782804.969789:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31013a1a00/0x6d98ed19b6370cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b6370d2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969794:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1a00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:2.0:1787782804.969796:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a1a00/0x6d98ed19b6370cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b6370d2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969803:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31013a1a00/0x6d98ed19b6370cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b6370d2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782804.969808:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a1a00/0x6d98ed19b6370cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b6370d2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782804.969819:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787782804.969834:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31013a1a00/0x6d98ed19b6370cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6370d2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969840:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782804.969846:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31013a1a00/0x6d98ed19b6370cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6370d2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969852:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31013a1a00/0x6d98ed19b6370cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6370d2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969861:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782804.969864:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3141255c00/0x6d98ed19b6370bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b6370c4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969869:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255c00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:2.0:1787782804.969871:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3141255c00/0x6d98ed19b6370bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b6370c4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969876:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3141255c00/0x6d98ed19b6370bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b6370c4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782804.969881:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3141255c00/0x6d98ed19b6370bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b6370c4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782804.969885:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787782804.969896:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3141255c00/0x6d98ed19b6370bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6370c4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969902:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782804.969922:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3141255c00/0x6d98ed19b6370bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6370c4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969929:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3141255c00/0x6d98ed19b6370bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6370c4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.969942:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782804.969943:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782804.969945:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782804.969952:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782804.969958:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782804.969969:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922387072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782804.970001:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782804.970020:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787782804.970025:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922387200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782804.970045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782804.970070:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787782804.970078:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922387328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782804.970119:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782804.970144:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922387072 00000100:00100000:2.0:1787782804.970148:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922387072 00010000:00010000:2.0:1787782804.970166:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c312f295a00/0x6d98ed19b6370e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b6370d9 expref: 19 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782804.970185:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922387200 00000100:00100000:2.0:1787782804.970188:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922387200 00010000:00010000:2.0:1787782804.970212:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3141255200/0x6d98ed19b6370d2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b6370cb expref: 20 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782804.970223:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922387328 00000100:00100000:2.0:1787782804.970231:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922387328 00010000:00010000:2.0:1787782804.970244:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31421fc800/0x6d98ed19b6370c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b6370bd expref: 21 pid: 5846 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782804.970257:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787782804.970262:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102e12850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db359560-8e1a-42c0-a155-5e020d83d9a3+21:3306:x1874625922387072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782804.970273:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782804.970277:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c312f295a00/0x6d98ed19b6370e0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b6370d9 expref: 21 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.970286:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c312f295a00/0x6d98ed19b6370e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b6370d9 expref: 21 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.970300:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782804.970327:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102e12850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db359560-8e1a-42c0-a155-5e020d83d9a3+21:3306:x1874625922387072:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782804.970334:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787782804.970373:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787782804.970379:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db359560-8e1a-42c0-a155-5e020d83d9a3+20:3306:x1874625922387200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782804.970385:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782804.970389:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3141255200/0x6d98ed19b6370d2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b6370cb expref: 20 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.970397:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3141255200/0x6d98ed19b6370d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b6370cb expref: 20 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.970406:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782804.970426:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db359560-8e1a-42c0-a155-5e020d83d9a3+20:3306:x1874625922387200:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782804.970431:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787782804.970450:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787782804.970455:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070ff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922387328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782804.970462:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782804.970466:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31421fc800/0x6d98ed19b6370c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b6370bd expref: 19 pid: 5846 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.970473:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31421fc800/0x6d98ed19b6370c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b6370bd expref: 19 pid: 5846 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.970483:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782804.970523:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070ff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922387328:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782804.970530:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787782804.970567:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922387328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782804.970591:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922387200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782804.970597:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922387072:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787782804.970745:0:11177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c312f295a00/0x6d98ed19b6370e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b6370d9 expref: 18 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782804.970767:0:11177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31342fcf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874625922386560:0@lo:104: 00010000:00010000:1.0:1787782804.970779:0:11177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3141255200/0x6d98ed19b6370d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b6370cb expref: 17 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782804.970788:0:11177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31342fe1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874625922386688:0@lo:104: 00010000:00010000:1.0:1787782804.970797:0:11177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31421fc800/0x6d98ed19b6370c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b6370bd expref: 16 pid: 5846 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782804.970804:0:11177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874625922386816:0@lo:104: 00000100:00100000:0.0:1787782804.977683:0:11177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31342fe580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874625922386432:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787782804.977700:0:11177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f134b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874625922386944:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787782804.977748:0:11177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c31421fce00/0x6d98ed19b637111 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782804.981958:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782804.982341:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904524288 00000100:00100000:2.0:1787782804.982353:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904524288 00010000:00010000:2.0:1787782804.982485:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b6370b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5221 expref: 13 pid: 5844 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782804.982586:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:2.0:1787782804.982596:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eedb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2350:x1874625904524288:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782804.982612:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782804.982627:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b6370b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5221 expref: 13 pid: 5844 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.982651:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b6370b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5221 expref: 13 pid: 5844 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.982669:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31029f4c00/0x6d98ed19b6370b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5221 expref: 13 pid: 5844 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.982685:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782804.982819:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eedb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ceacfe35-7480-471c-a7cd-7a05a1613220+12:2350:x1874625904524288:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 223us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782804.982826:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:3.0:1787782804.983964:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782804.984013:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904524416 00000100:00100000:2.0:1787782804.984021:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904524416 00010000:00010000:2.0:1787782804.984048:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31013a1600/0x6d98ed19b6370f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5259 expref: 12 pid: 5845 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782804.984084:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:2.0:1787782804.984293:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ceacfe35-7480-471c-a7cd-7a05a1613220+12:2352:x1874625904524416:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782804.984310:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782804.984316:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31013a1600/0x6d98ed19b6370f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5259 expref: 12 pid: 5845 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.984328:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31013a1600/0x6d98ed19b6370f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5259 expref: 12 pid: 5845 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.984344:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31013a1600/0x6d98ed19b6370f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5259 expref: 12 pid: 5845 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.984360:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c31421fce00/0x6d98ed19b637111 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.984381:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31421fce00/0x6d98ed19b637111 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.984866:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c31421fce00/0x6d98ed19b637111 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.984876:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c31421fce00/0x6d98ed19b637111 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.984883:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c31421fce00/0x6d98ed19b637111 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.984889:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c31421fce00/0x6d98ed19b637111 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.984895:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fce00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787782804.984899:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c31421fce00/0x6d98ed19b637111 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.984906:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c31421fce00/0x6d98ed19b637111 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782804.985018:0:11177:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c31421fce00/0x6d98ed19b637111 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782804.985026:0:11177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c31421fce00/0x6d98ed19b637111 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.986673:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c31421fce00/0x6d98ed19b637111 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.986690:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31421fce00/0x6d98ed19b637111 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782804.986711:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782804.986792:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ceacfe35-7480-471c-a7cd-7a05a1613220+11:2352:x1874625904524416:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 2695us (2827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782804.986814:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 29 00010000:00010000:2.0:1787782805.857538:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782806.029002:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782806.029071:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782806.029164:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782806.029266:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904524800 00000100:00100000:0.0:1787782806.029282:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904524800 00000100:00100000:1.0:1787782806.029356:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904524672 00000100:00100000:1.0:1787782806.029374:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904524672 00000100:00100000:0.0:1787782806.029407:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 96 00000100:00100000:0.0:1787782806.029424:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2352:x1874625904524800:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782806.029534:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00100000:1.0:1787782806.029548:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2352:x1874625904524672:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782806.029561:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2352:x1874625904524800:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 136us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782806.029583:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 96 00000100:00100000:2.0:1787782806.029729:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904524544 00000100:00100000:2.0:1787782806.029736:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904524544 00000100:00100000:2.0:1787782806.029788:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 233 00000100:00100000:2.0:1787782806.029796:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+11:2352:x1874625904524544:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782806.029863:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+11:2352:x1874625904524544:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 68us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782806.029863:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2352:x1874625904524672:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 318us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782806.029871:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 233 00000100:00100000:1.0:1787782806.029872:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00080000:3.0:1787782806.030165:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1787782806.114748:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787782806.114756:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c310712b000 from 7 10000000:01000000:0.0:1787782806.114762:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787782806.114812:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255400/0x6d98ed19b637118 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782806.114826:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141255400/0x6d98ed19b637118 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782806.114838:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141255400/0x6d98ed19b637118 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782806.114865:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922387456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787782806.114933:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782806.114995:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2000 going to sleep for 11 seconds 00000100:00100000:2.0:1787782806.115059:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922387456 00000100:00100000:2.0:1787782806.115067:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922387456 00000100:00100000:2.0:1787782806.116061:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787782806.116078:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922387456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782806.116116:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782806.116136:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c312f295a00/0x6d98ed19b63711f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b637118 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782806.116163:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c312f295a00/0x6d98ed19b63711f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b637118 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782806.116174:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c312f295a00/0x6d98ed19b63711f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b637118 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782806.116184:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312f295a00, rc 0) 00000100:00100000:2.0:1787782806.119512:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922387456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3431us (4569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782806.119526:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787782806.119933:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922387456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782806.119972:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141255400/0x6d98ed19b637118 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63711f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782806.119985:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141255400/0x6d98ed19b637118 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b63711f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782806.120058:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922387584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782806.120111:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782806.120146:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2000 going to sleep for 11 seconds 00000100:00100000:0.0:1787782806.120166:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922387584 00000100:00100000:0.0:1787782806.120171:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922387584 00000100:00100000:0.0:1787782806.121082:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787782806.121115:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922387584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782806.127277:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922387584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6172us (7167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782806.127292:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787782806.127470:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922387584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782806.127540:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922387712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782806.127602:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782806.127648:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2000 going to sleep for 11 seconds 00000100:00100000:1.0:1787782806.128023:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922387712 00000100:00100000:1.0:1787782806.128031:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922387712 00000100:00100000:1.0:1787782806.128078:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787782806.128086:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922387712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787782806.128278:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922387712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 192us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782806.128293:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787782806.128472:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922387712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787782806.130058:0:11193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787782806.143561:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787782806.143603:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787782806.143615:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255400/0x6d98ed19b637118 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63711f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782806.143629:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141255400/0x6d98ed19b637118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63711f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782806.143640:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787782806.143643:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3129b5d800 from 7 10000000:01000000:1.0:1787782806.143646:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787782806.143685:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b637126 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782806.143693:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b637126 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782806.143703:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b637126 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782806.143728:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f135e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922387840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787782806.143800:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782806.143847:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1e300 going to sleep for 11 seconds 00000100:00100000:0.0:1787782806.143985:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922387840 00000100:00100000:0.0:1787782806.143992:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922387840 00000100:00100000:0.0:1787782806.144041:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787782806.144049:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922387840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782806.144062:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782806.144073:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141254200/0x6d98ed19b63712d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b637126 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782806.144139:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141254200/0x6d98ed19b63712d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b637126 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782806.144149:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141254200/0x6d98ed19b63712d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b637126 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782806.144157:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254200, rc 0) 00000100:00100000:0.0:1787782806.144197:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922387840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782806.144204:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787782806.144354:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f135e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922387840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787782806.144369:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b637126 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63712d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782806.144377:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b637126 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b63712d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782806.144444:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e89680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922387968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787782806.144475:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782806.144512:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129c58600 going to sleep for 11 seconds 00000100:00100000:0.0:1787782806.148293:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922387968 00000100:00100000:0.0:1787782806.148308:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922387968 00000100:00100000:0.0:1787782806.148364:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1787782806.148374:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922387968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782806.148707:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922387968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (4229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782806.148715:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787782806.148836:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e89680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922387968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787782806.148889:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e89680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922388096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787782806.148936:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782806.148975:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129c58600 going to sleep for 11 seconds 00000100:00100000:1.0:1787782806.149267:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922388096 00000100:00100000:1.0:1787782806.149273:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922388096 00000100:00100000:1.0:1787782806.149310:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787782806.149318:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922388096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787782806.149475:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922388096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782806.149499:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787782806.149634:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e89680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922388096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787782806.150884:0:11195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787782806.151081:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787782806.151126:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787782806.151138:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b637126 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63712d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782806.151148:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b637126 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63712d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782806.151158:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787782806.151160:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c311846c800 from 7 10000000:01000000:3.0:1787782806.151163:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787782806.151196:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b637134 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782806.151203:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b637134 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782806.151214:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b637134 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782806.151245:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e89680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922388224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787782806.151296:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782806.151329:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129c58600 going to sleep for 11 seconds 00000100:00100000:1.0:1787782806.151444:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922388224 00000100:00100000:1.0:1787782806.151451:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922388224 00000100:00100000:1.0:1787782806.151501:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787782806.151510:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922388224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782806.151521:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782806.151536:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31421fce00/0x6d98ed19b63713b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b637134 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782806.151558:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31421fce00/0x6d98ed19b63713b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b637134 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782806.151568:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31421fce00/0x6d98ed19b63713b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b637134 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782806.151577:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31421fce00, rc 0) 00000100:00100000:1.0:1787782806.151628:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922388224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782806.151635:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787782806.152066:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e89680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922388224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782806.152080:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b637134 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63713b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782806.152088:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b637134 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b63713b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782806.152164:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922388352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782806.152209:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782806.152336:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922388352 00000100:00100000:3.0:1787782806.152340:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922388352 00000100:00100000:3.0:1787782806.152365:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787782806.152372:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922388352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787782806.152638:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922388352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782806.152655:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787782806.152866:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2300 going to sleep for 11 seconds 00000100:00100000:0.0:1787782806.152883:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922388352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782806.152914:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922388480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782806.152952:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782806.152975:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2300 going to sleep for 11 seconds 00000100:00100000:3.0:1787782806.153664:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922388480 00000100:00100000:3.0:1787782806.153672:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922388480 00000100:00100000:3.0:1787782806.153716:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787782806.153723:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922388480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787782806.153950:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922388480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782806.153956:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787782806.162951:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922388480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787782806.166709:0:11197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787782806.174910:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787782806.174949:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787782806.174960:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b637134 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63713b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782806.174972:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b637134 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63713b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782806.798865:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782806.798975:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904524928 00000100:00100000:1.0:1787782806.798986:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904524928 00000100:00100000:1.0:1787782806.799048:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 243 00000100:00100000:1.0:1787782806.799059:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+11:5590:x1874625904524928:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782806.799076:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782806.799128:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31421fd800/0x6d98ed19b637142 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e5283 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782806.799157:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31421fd800/0x6d98ed19b637142 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5283 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782806.799168:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31421fd800/0x6d98ed19b637142 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5283 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782806.799176:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31421fd800, rc 0) 00000100:00100000:1.0:1787782806.799238:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+12:5590:x1874625904524928:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 180us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782806.799245:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 243 00000100:00100000:3.0:1787782806.802263:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782806.804914:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904525056 00000100:00100000:0.0:1787782806.804928:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904525056 00000100:00100000:0.0:1787782806.804986:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 244 00000100:00100000:0.0:1787782806.804994:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3107e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+12:5590:x1874625904525056:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782806.805303:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3107e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+12:5590:x1874625904525056:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 308us (3050us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782806.805311:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 244 00000100:00100000:2.0:1787782806.823792:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782806.824016:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904525184 00000100:00100000:0.0:1787782806.824026:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904525184 00000100:00100000:0.0:1787782806.824087:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 245 00000100:00100000:0.0:1787782806.824114:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3107e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+12:5590:x1874625904525184:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782806.824341:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3107e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+12:5590:x1874625904525184:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 244us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782806.824349:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 245 00000100:00100000:0.0:1787782806.838561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782806.838777:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904525312 00000100:00100000:2.0:1787782806.838788:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904525312 00000100:00100000:2.0:1787782806.838849:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 246 00000100:00100000:2.0:1787782806.838859:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+12:5590:x1874625904525312:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782806.838879:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782806.838896:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c312f294000/0x6d98ed19b637149 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e528a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782806.838927:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c312f294000/0x6d98ed19b637149 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e528a expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782806.838938:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c312f294000/0x6d98ed19b637149 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e528a expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782806.838946:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312f294000, rc 0) 00000100:00100000:2.0:1787782806.839018:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:5590:x1874625904525312:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 160us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782806.839025:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 246 00000100:00100000:1.0:1787782806.851354:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782806.851432:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904525440 00000100:00100000:0.0:1787782806.851442:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904525440 00000100:00100000:0.0:1787782806.851505:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 247 00000100:00100000:0.0:1787782806.851515:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:5590:x1874625904525440:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782806.851794:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:5590:x1874625904525440:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 280us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782806.851802:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 247 00000100:00100000:1.0:1787782806.864632:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782806.864803:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904525568 00000100:00100000:2.0:1787782806.864812:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904525568 00000100:00100000:2.0:1787782806.864868:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 248 00000100:00100000:2.0:1787782806.864877:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:5590:x1874625904525568:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782806.865078:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:5590:x1874625904525568:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 201us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782806.865086:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 248 00010000:00010000:1.0:1787782806.891739:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782807.144217:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787782807.144370:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787782807.144406:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f135e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922388992:0@lo:400:kworker.0 00000100:00100000:2.0:1787782807.144489:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782807.144569:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922388992 00000100:00100000:2.0:1787782807.144577:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922388992 00000100:00100000:2.0:1787782807.144632:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787782807.144641:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922388992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782807.144688:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922388992:12345-0@lo:400:kworker.0 Request processed in 48us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782807.144695:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787782807.144715:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787782807.144742:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f135e00 x1874625922388992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782807.144756:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f135e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922388992:0@lo:400:kworker.0 00000100:00100000:0.0:1787782807.149117:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922388608:0@lo:400:kworker.0 00000100:00100000:0.0:1787782807.149198:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782807.149303:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f135680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922388736:0@lo:400:kworker.0 00000100:00100000:0.0:1787782807.149333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782807.149357:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782807.149363:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922388864:0@lo:400:kworker.0 00000100:00100000:0.0:1787782807.149383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782807.149410:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922388736 00000100:00100000:0.0:1787782807.149418:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922388736 00000100:00100000:0.0:1787782807.149462:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922388864 00000100:00100000:0.0:1787782807.149465:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922388864 00000100:00100000:0.0:1787782807.149507:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787782807.149516:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922388736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782807.149566:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922388736:12345-0@lo:400:kworker.0 Request processed in 52us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782807.149572:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787782807.149588:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787782807.149594:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922388864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782807.149619:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922388864:12345-0@lo:400:kworker.0 Request processed in 25us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782807.149624:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787782807.149659:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922388864:0@lo:400:kworker.0 00000100:00100000:0.0:1787782807.149678:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f135680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922388736:0@lo:400:kworker.0 00000100:00100000:2.0:1787782807.149787:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922388608 00000100:00100000:2.0:1787782807.149791:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922388608 00000100:00100000:2.0:1787782807.149824:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787782807.149830:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3304:x1874625922388608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782807.149883:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3304:x1874625922388608:12345-0@lo:400:kworker.0 Request processed in 52us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782807.149889:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:2.0:1787782807.149925:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782807.149942:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922388608:0@lo:400:kworker.0 00000100:00100000:1.0:1787782807.155208:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922389248:0@lo:400:kworker.0 00000100:00100000:1.0:1787782807.155283:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782807.155488:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f134b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922389120:0@lo:400:kworker.0 00000100:00100000:0.0:1787782807.155522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782807.157341:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922389120 00000100:00100000:1.0:1787782807.157354:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922389120 00000100:00100000:1.0:1787782807.157440:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787782807.157451:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922389120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782807.157554:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922389120:12345-0@lo:400:kworker.0 Request processed in 105us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782807.157561:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787782807.157611:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f134b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922389120:0@lo:400:kworker.0 00000100:00080000:0.0:1787782807.157690:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782807.159012:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922389248 00000100:00100000:2.0:1787782807.159022:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922389248 00000100:00100000:2.0:1787782807.159122:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787782807.159132:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f135680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922389248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782807.159214:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f135680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922389248:12345-0@lo:400:kworker.0 Request processed in 84us (3931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782807.159223:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1787782807.159376:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787782807.159529:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f1361c0 x1874625922389248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782807.159543:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922389248:0@lo:400:kworker.0 00000100:00100000:3.0:1787782807.664843:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922389376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782807.664921:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782807.665607:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922389504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782807.665656:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782807.666713:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922389376 00000100:00100000:3.0:1787782807.666723:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922389376 00000100:00100000:3.0:1787782807.666776:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922389504 00000100:00100000:3.0:1787782807.666780:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922389504 00000100:00100000:3.0:1787782807.666798:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787782807.666808:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922389376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787782807.666847:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782807.666913:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922389376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782807.666920:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787782807.666937:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787782807.666944:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f134b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922389504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782807.666963:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782807.667009:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f134b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922389504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782807.667016:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787782807.667055:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f1361c0 x1874625922389504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782807.667076:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922389504:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787782807.667132:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31070fde00 x1874625922389376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782807.667146:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922389376:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787782807.905766:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782808.929437:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782809.955579:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787782809.960602:0:11376:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787782810.977885:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782811.148215:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782811.148250:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782811.148287:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782811.148490:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904525952 00000100:00100000:2.0:1787782811.148502:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904525952 00000100:00100000:3.0:1787782811.148506:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904525824 00000100:00100000:3.0:1787782811.148510:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904525824 00000100:00100000:0.0:1787782811.148573:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904525696 00000100:00100000:0.0:1787782811.148576:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904525696 00000100:00100000:0.0:1787782811.148632:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 250 00000100:00100000:0.0:1787782811.148642:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2351:x1874625904525696:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782811.148714:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2351:x1874625904525696:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 74us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782811.148722:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 250 00000100:00100000:2.0:1787782811.149023:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:2.0:1787782811.149031:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2351:x1874625904525952:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782811.149065:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2351:x1874625904525952:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 35us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782811.149071:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:3.0:1787782811.152141:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 102 00000100:00100000:3.0:1787782811.152158:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f135e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2351:x1874625904525824:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782811.152247:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f135e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2351:x1874625904525824:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 93us (3958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782811.152256:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 102 00000100:00080000:1.0:1787782811.157469:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787782812.003898:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782812.258411:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922390016:0@lo:400:kworker.0 00000100:00100000:3.0:1787782812.258501:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782812.258566:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787782812.258572:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922389632:0@lo:400:kworker.0 00000100:00100000:3.0:1787782812.258600:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782812.258620:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922390144:0@lo:400:kworker.0 00000100:00100000:3.0:1787782812.258655:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782812.258687:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922389760:0@lo:400:kworker.0 00000100:00100000:3.0:1787782812.258709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782812.258724:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922390272:0@lo:400:kworker.0 00000100:00100000:3.0:1787782812.258746:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782812.258764:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787782812.258769:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922389888:0@lo:400:kworker.0 00000100:00100000:3.0:1787782812.258791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782812.258822:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922390144 00000100:00100000:3.0:1787782812.258829:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922390144 00000100:00100000:3.0:1787782812.258874:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922389760 00000100:00100000:3.0:1787782812.258877:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922389760 00000100:00100000:3.0:1787782812.258888:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922389888 00000100:00100000:3.0:1787782812.258890:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922389888 00000100:00100000:3.0:1787782812.258905:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787782812.258912:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922390144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782812.258963:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922390144:12345-0@lo:400:kworker.0 Request processed in 51us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782812.258970:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787782812.258988:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787782812.258993:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922389760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782812.259023:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922389760:12345-0@lo:400:kworker.0 Request processed in 30us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782812.259029:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787782812.259040:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787782812.259047:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922389888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782812.259073:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922389888:12345-0@lo:400:kworker.0 Request processed in 27us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782812.259091:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787782812.259091:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922389632 00000100:00100000:0.0:1787782812.259122:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922389632 00000100:00080000:3.0:1787782812.259133:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782812.259156:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787782812.259165:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3304:x1874625922389632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782812.259169:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922389888:0@lo:400:kworker.0 00000100:00100000:3.0:1787782812.259183:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922389760:0@lo:400:kworker.0 00000100:00100000:0.0:1787782812.259216:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3304:x1874625922389632:12345-0@lo:400:kworker.0 Request processed in 51us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782812.259220:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922389632:0@lo:400:kworker.0 00000100:00100000:0.0:1787782812.259228:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787782812.259235:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922390144:0@lo:400:kworker.0 00000100:00100000:2.0:1787782812.260047:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922390016 00000100:00100000:2.0:1787782812.260055:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922390016 00000100:00100000:2.0:1787782812.261725:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922390272 00000100:00100000:2.0:1787782812.261735:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922390272 00000100:00100000:3.0:1787782812.262078:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787782812.262091:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eed92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922390016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782812.262218:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eed92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922390016:12345-0@lo:400:kworker.0 Request processed in 130us (3716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782812.262226:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1787782812.262285:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3119e88b40 x1874625922390016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782812.262389:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922390016:0@lo:400:kworker.0 00000100:00080000:0.0:1787782812.265553:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787782812.265565:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787782812.266773:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787782812.266788:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922390272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782812.266893:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922390272:12345-0@lo:400:kworker.0 Request processed in 110us (8144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782812.266901:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1787782812.266969:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3119e89680 x1874625922390272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782828 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782812.266985:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922390272:0@lo:400:kworker.0 00000100:00100000:1.0:1787782812.771067:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782812.771092:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f1352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922390400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782812.771212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782812.771290:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922390400 00000100:00100000:1.0:1787782812.771299:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922390400 00000100:00100000:1.0:1787782812.771345:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787782812.771355:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f1361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922390400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782812.771390:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782812.771447:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f1361c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922390400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782812.771454:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787782812.771505:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c312f1352c0 x1874625922390400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782812.771523:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f1352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922390400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782812.778700:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922390528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782812.778770:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782812.778962:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922390528 00000100:00100000:2.0:1787782812.778982:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922390528 00000100:00100000:2.0:1787782812.779029:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787782812.779039:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922390528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787782812.779072:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787782812.779143:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922390528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782812.779150:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1787782812.779266:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c313c94e580 x1874625922390528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782812.779296:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922390528:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787782813.025877:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782814.054477:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787782814.732439:0:11476:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 18:20:12 (1787782812) === 00000100:00100000:1.0:1787782814.995972:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782814.996236:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782814.996322:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904526208 00000100:00100000:1.0:1787782814.996346:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904526208 00000100:00100000:1.0:1787782814.996546:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:1.0:1787782814.996561:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:9689:x1874625904526208:12345-192.168.202.15@tcp:700:mkdir.0 00000100:00100000:1.0:1787782814.996675:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:9689:x1874625904526208:12345-192.168.202.15@tcp:700:mkdir.0 Request processed in 118us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782814.996684:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00080000:0.0:1787782814.996887:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782815.006849:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904526080 00000100:00100000:3.0:1787782815.006872:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904526080 00000100:00100000:3.0:1787782815.007136:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:3.0:1787782815.007152:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f1352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904526080:12345-192.168.202.15@tcp:41:mkdir.0 00000004:00000024:3.0:1787782815.007213:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787782815.007362:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f1352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904526080:12345-192.168.202.15@tcp:41:mkdir.0 Request processed in 214us (11406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782815.007372:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:2.0:1787782815.008747:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782815.010010:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904526464 00000100:00100000:1.0:1787782815.010029:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904526464 00000100:00100000:1.0:1787782815.010171:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:1.0:1787782815.010183:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:9689:x1874625904526464:12345-192.168.202.15@tcp:36:mkdir.0 00010000:00010000:1.0:1787782815.010267:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782815.010541:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b637031 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e520c expref: 6 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.010584:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3108738600) 00010000:00010000:1.0:1787782815.010607:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787782815.010968:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31421fc600/0x6d98ed19b637150 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.010983:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31421fc600/0x6d98ed19b637150 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.011006:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31421fc600/0x6d98ed19b637150 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.011062:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6e00/0x6d98ed19b637157 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.011072:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6e00/0x6d98ed19b637157 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.011081:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6e00/0x6d98ed19b637157 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782815.012421:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787782815.012437:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31421fc600/0x6d98ed19b637150 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.012447:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31421fc600/0x6d98ed19b637150 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.012455:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31421fc600/0x6d98ed19b637150 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.012460:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fc600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782815.012464:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31421fc600/0x6d98ed19b637150 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.012472:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31421fc600/0x6d98ed19b637150 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.012485:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782815.012489:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782815.012503:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31421fc600/0x6d98ed19b637150 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.012509:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31421fc600/0x6d98ed19b637150 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787782815.012529:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fe16eef reply state 00000000bea57b99 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6e00/0x6d98ed19b637157 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782815.012538:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787782815.012662:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+7:9689:x1874625904526464:12345-192.168.202.15@tcp:36:mkdir.0 Request processed in 2477us (3921us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787782815.012672:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00010000:00010000:0.0:1787782815.018180:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6e00/0x6d98ed19b637157 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.018205:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6e00/0x6d98ed19b637157 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.018215:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6e00/0x6d98ed19b637157 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.018222:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782815.018228:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6e00/0x6d98ed19b637157 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.018237:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6e00/0x6d98ed19b637157 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.018263:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c312eeef600) 00010000:00010000:0.0:1787782815.018267:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782815.018273:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6e00/0x6d98ed19b637157 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.018280:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6e00/0x6d98ed19b637157 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782815.033236:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782815.035485:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904526592 00000100:00100000:3.0:1787782815.035507:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904526592 00000100:00100000:3.0:1787782815.035615:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:3.0:1787782815.035627:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:9690:x1874625904526592:12345-192.168.202.15@tcp:101:chmod.0 00010000:00010000:3.0:1787782815.035657:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782815.035692:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63715e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5291 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.035786:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0800/0x6d98ed19b637165 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.035803:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0800/0x6d98ed19b637165 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.035817:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0800/0x6d98ed19b637165 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782815.035918:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787782815.035923:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787782815.035982:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0800/0x6d98ed19b637165 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.036017:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63715e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5291 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.036042:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0800/0x6d98ed19b637165 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5291 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.036052:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3104d6ec00) 00010000:00010000:3.0:1787782815.036056:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787782815.036078:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0800, rc 0) 00000100:00100000:3.0:1787782815.036237:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+7:9690:x1874625904526592:12345-192.168.202.15@tcp:101:chmod.0 Request processed in 612us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782815.036245:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:2.0:1787782815.040388:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782815.040559:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904526848 00000100:00100000:0.0:1787782815.040574:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904526848 00000100:00100000:0.0:1787782815.040653:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:0.0:1787782815.040687:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+7:9690:x1874625904526848:12345-192.168.202.15@tcp:36:chmod.0 00010000:00010000:0.0:1787782815.040769:0:6719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782815.040804:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0800/0x6d98ed19b637165 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5291 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.040828:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3104d6ec00) 00010000:00010000:0.0:1787782815.040842:0:6719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787782815.040879:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63716c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.040895:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63716c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.040908:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63716c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787782815.041379:0:6719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000deea001e reply state 0000000087e334bd transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63716c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782815.041392:0:6719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787782815.041421:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787782815.041554:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+8:9690:x1874625904526848:12345-192.168.202.15@tcp:36:chmod.0 Request processed in 869us (1181us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787782815.041562:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00010000:00010000:0.0:1787782815.046634:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63716c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.046657:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63716c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.046666:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63716c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.046693:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782815.046699:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63716c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.046707:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63716c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.046731:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c310823cd00) 00010000:00010000:0.0:1787782815.046734:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787782815.046740:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63716c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.046746:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63716c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782815.075435:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782815.093255:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782815.093653:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904526976 00000100:00100000:3.0:1787782815.093669:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904526976 00000100:00100000:3.0:1787782815.093762:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:3.0:1787782815.093775:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+7:9691:x1874625904526976:12345-192.168.202.15@tcp:101:chown.0 00010000:00010000:3.0:1787782815.093811:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782815.093845:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637173 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5298 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.093938:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b63717a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.093955:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b63717a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.093970:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b63717a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782815.094059:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787782815.094064:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787782815.100019:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b63717a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.100576:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637173 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5298 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.100608:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b63717a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5298 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.100685:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3104d6e100) 00010000:00010000:0.0:1787782815.100688:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787782815.100693:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0000, rc 0) 00000100:00100000:0.0:1787782815.100872:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+8:9691:x1874625904526976:12345-192.168.202.15@tcp:101:chown.0 Request processed in 7090us (7626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782815.100908:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:1.0:1787782815.109211:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782815.109742:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904527104 00000100:00100000:0.0:1787782815.109758:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904527104 00000100:00100000:0.0:1787782815.109842:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:0.0:1787782815.109853:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141211a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+8:9691:x1874625904527104:12345-192.168.202.15@tcp:101:chown.0 00010000:00010000:0.0:1787782815.109883:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782815.109908:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637181 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e529f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.109991:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637188 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110007:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637188 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110020:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637188 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110037:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b63718f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110044:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b63718f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110050:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b63718f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110221:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b637196 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110246:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b637196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110254:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b637196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782815.110312:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787782815.110317:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787782815.110854:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b637196 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110873:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637188 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110880:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637188 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110888:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637188 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110894:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782815.110899:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637188 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110907:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637188 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110922:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3104d6e100) 00010000:00010000:0.0:1787782815.110926:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782815.110931:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637188 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110951:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637188 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110969:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b63718f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110974:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b63718f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110979:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b63718f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110984:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782815.110987:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b63718f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.110992:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b63718f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.111000:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c310823cd00) 00010000:00010000:0.0:1787782815.111002:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782815.111005:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b63718f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.111010:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b63718f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.111055:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637181 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e529f expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.111069:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b637196 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e529f expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.111086:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c310823ce00) 00010000:00010000:0.0:1787782815.111088:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787782815.111091:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254000, rc 0) 00000100:00100000:1.0:1787782815.113392:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141211a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+9:9691:x1874625904527104:12345-192.168.202.15@tcp:101:chown.0 Request processed in 3516us (4174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782815.113417:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:2.0:1787782815.121010:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782815.121470:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904527360 00000100:00100000:3.0:1787782815.121485:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904527360 00000100:00100000:3.0:1787782815.121611:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:3.0:1787782815.121634:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+9:9691:x1874625904527360:12345-192.168.202.15@tcp:36:chown.0 00010000:00010000:3.0:1787782815.121719:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782815.121758:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b637196 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e529f expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.121801:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c310823ce00) 00010000:00010000:3.0:1787782815.121817:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787782815.121857:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63719d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.121874:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63719d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.121885:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63719d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787782815.159748:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002109050a reply state 00000000734bf0b5 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63719d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782815.159768:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787782815.159950:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787782815.160071:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+10:9691:x1874625904527360:12345-192.168.202.15@tcp:36:chown.0 Request processed in 38435us (39134us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787782815.160080:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000001:00080000:1.0:1787782815.160195:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:1.0:1787782815.160228:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:3.0:1787782815.160277:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63719d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.160287:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63719d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.160296:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63719d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.160303:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782815.160308:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63719d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.160325:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63719d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.160351:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c3104d6e200) 00010000:00010000:3.0:1787782815.160355:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787782815.160469:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63719d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.160477:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63719d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782815.193996:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782815.194984:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904527488 00000100:00100000:0.0:1787782815.194995:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904527488 00000100:00100000:0.0:1787782815.195052:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:0.0:1787782815.195060:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:9692:x1874625904527488:12345-192.168.202.15@tcp:101:touch.500 00010000:00010000:0.0:1787782815.195084:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782815.195590:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6371a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e52a6 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787782815.199962:0:6719:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4317us 00010000:00010000:1.0:1787782815.218012:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.218060:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.218073:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.218092:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6000/0x6d98ed19b6371b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.218122:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6000/0x6d98ed19b6371b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.218151:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6000/0x6d98ed19b6371b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.219615:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b6371b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.219632:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b6371b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.219642:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b6371b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782815.221437:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787782815.221447:0:6719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787782815.221650:0:6719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b6371b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.221670:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.221677:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371ab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.221684:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.221691:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782815.221695:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.221704:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.222638:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3104d6e100) 00010000:00010000:1.0:1787782815.222648:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782815.222656:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.222665:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.222683:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6000/0x6d98ed19b6371b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.222689:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6000/0x6d98ed19b6371b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.222696:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6000/0x6d98ed19b6371b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.222701:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782815.222704:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6000/0x6d98ed19b6371b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.222712:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6000/0x6d98ed19b6371b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.222722:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782815.222724:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782815.223162:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6000/0x6d98ed19b6371b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.223168:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6000/0x6d98ed19b6371b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.223223:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6371a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52a6 expref: 8 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.223234:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b6371b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52a6 expref: 7 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.223239:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c312eeef000) 00010000:00010000:1.0:1787782815.223241:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787782815.223243:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6c00, rc 0) 00000100:00100000:1.0:1787782815.223314:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+7:9692:x1874625904527488:12345-192.168.202.15@tcp:101:touch.500 Request processed in 28252us (29326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782815.223323:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:1.0:1787782815.235364:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782815.235522:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904527744 00000100:00100000:0.0:1787782815.235532:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904527744 00000100:00100000:0.0:1787782815.235594:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:0.0:1787782815.235604:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141210f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+7:9692:x1874625904527744:12345-192.168.202.15@tcp:101:touch.500 00010000:00010000:0.0:1787782815.235626:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782815.235647:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6371c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e52ad expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.236006:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6371c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.236022:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6371c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.236035:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6371c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.236251:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6371ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.236269:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6371ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.236277:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6371ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787782815.238594:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787782815.241652:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6000/0x6d98ed19b6371d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.241791:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6000/0x6d98ed19b6371d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.241806:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6000/0x6d98ed19b6371d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.241844:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6371c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.241851:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6371c7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.241875:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6371c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.241881:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782815.241885:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6371c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.241893:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6371c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.241905:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c312eeef000) 00010000:00010000:1.0:1787782815.241908:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782815.241912:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6371c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.241919:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6371c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787782815.241932:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f26a614 reply state 000000007e9c852d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6371ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782815.241941:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787782815.241976:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6371c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52ad expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.241989:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6000/0x6d98ed19b6371d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52ad expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.241996:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782815.241999:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782815.242006:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6000, rc 0) 00000100:00100000:1.0:1787782815.242179:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141210f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+10:9692:x1874625904527744:12345-192.168.202.15@tcp:101:touch.500 Request processed in 6575us (6824us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787782815.242188:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:2.0:1787782815.247649:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:3.0:1787782815.247921:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6371ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.247935:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6371ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.247943:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6371ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.247950:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782815.247954:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6371ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.247963:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6371ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.247979:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff8c310823cd00) 00010000:00010000:3.0:1787782815.247983:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782815.247988:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6371ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.248013:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6371ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782815.248076:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904528000 00000100:00100000:1.0:1787782815.248086:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904528000 00000100:00100000:1.0:1787782815.248810:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:1.0:1787782815.248821:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+9:9692:x1874625904528000:12345-192.168.202.15@tcp:36:touch.500 00010000:00010000:1.0:1787782815.248881:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782815.248902:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6000/0x6d98ed19b6371d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52ad expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.248915:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782815.248923:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787782815.248963:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.248975:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.248985:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787782815.249239:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa40af1e reply state 00000000111b0e0b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782815.249248:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787782815.249522:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+10:9692:x1874625904528000:12345-192.168.202.15@tcp:36:touch.500 Request processed in 702us (1882us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787782815.249531:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 23 00010000:00010000:1.0:1787782815.251973:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.251989:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.251997:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.252003:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782815.252008:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.252016:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.252033:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c312eeef200) 00010000:00010000:1.0:1787782815.252036:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782815.252041:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.252047:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6371e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782815.258672:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782815.258963:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904528128 00000100:00100000:3.0:1787782815.258974:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904528128 00000100:00100000:3.0:1787782815.259036:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:3.0:1787782815.259046:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+9:9692:x1874625904528128:12345-192.168.202.15@tcp:101:touch.500 00010000:00010000:3.0:1787782815.259072:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782815.259237:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b6371ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e52b4 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782815.259962:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b6371ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52b4 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782815.259981:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b6371ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52b4 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782815.260003:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c3104d6e200) 00010000:00010000:2.0:1787782815.260007:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787782815.260025:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1e00, rc 0) 00000100:00100000:2.0:1787782815.260122:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+10:9692:x1874625904528128:12345-192.168.202.15@tcp:101:touch.500 Request processed in 1047us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782815.260132:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:2.0:1787782815.263604:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782815.263757:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904528256 00000100:00100000:3.0:1787782815.263767:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904528256 00000100:00100000:3.0:1787782815.263812:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:3.0:1787782815.263821:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1874625904528256:12345-192.168.202.15@tcp:8:touch.500 00010000:00080000:3.0:1787782815.263852:0:6697:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp t0 exp 0000000000000000 cur 299 last 0 00000020:00000080:3.0:1787782815.263927:0:6697:0:(genops.c:1385:class_connect()) connect: client 6e4b0e72-6952-496d-b228-ab2778cd786f, cookie 0x6d98ed19b6371f1 00002000:00100000:3.0:1787782815.263940:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e4b0e72-6952-496d-b228-ab2778cd786f/ffff8c3133fc2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113937 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787782815.263962:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787782815.264529:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787782815.264563:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8c3133fc0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787782815.264802:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2348:x1874625904528256:12345-192.168.202.15@tcp:8:touch.500 Request processed in 979us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782815.264812:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:1.0:1787782815.271844:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782815.271947:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904528384 00000100:00100000:2.0:1787782815.271956:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904528384 00000100:00100000:2.0:1787782815.272030:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:2.0:1787782815.272039:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141211e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:0:x1874625904528384:12345-192.168.202.15@tcp:2:touch.500 00000100:00080000:0.0:1787782815.272344:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787782815.355063:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1787782815.355083:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e4b0e72-6952-496d-b228-ab2778cd786f 00000100:00100000:0.0:1787782815.368958:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141211e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:0:x1874625904528384:12345-192.168.202.15@tcp:2:touch.500 Request processed in 96909us (97112us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787782815.368972:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:1.0:1787782815.372571:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782815.372806:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904528640 00000100:00100000:3.0:1787782815.372844:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904528640 00000100:00100000:3.0:1787782815.372935:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:3.0:1787782815.372947:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31412130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+10:9692:x1874625904528640:12345-192.168.202.15@tcp:35:touch.500 00000100:00100000:3.0:1787782815.373603:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31412130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+11:9692:x1874625904528640:12345-192.168.202.15@tcp:35:touch.500 Request processed in 656us (1039us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787782815.373612:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:2.0:1787782815.396063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782815.396217:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904528768 00000100:00100000:0.0:1787782815.396228:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904528768 00000100:00100000:0.0:1787782815.396280:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:0.0:1787782815.396289:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+11:9693:x1874625904528768:12345-192.168.202.15@tcp:101:rm.0 00010000:00010000:0.0:1787782815.396312:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782815.396333:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6371f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e52bb expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.396434:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6371ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.396449:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6371ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.396463:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6371ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782815.396528:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787782815.396532:0:6719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787782815.396600:0:6719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6371ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.396629:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6371f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52bb expref: 13 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.396648:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6371ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52bb expref: 12 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.396657:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c312eeef000) 00010000:00010000:0.0:1787782815.396660:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787782815.396665:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255800, rc 0) 00000100:00100000:0.0:1787782815.396724:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+12:9693:x1874625904528768:12345-192.168.202.15@tcp:101:rm.0 Request processed in 437us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782815.396732:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:2.0:1787782815.402916:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782815.403021:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904529024 00000100:00100000:1.0:1787782815.403035:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904529024 00000100:00100000:1.0:1787782815.403156:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:1.0:1787782815.403168:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+12:9693:x1874625904529024:12345-192.168.202.15@tcp:101:rm.0 00010000:00010000:1.0:1787782815.403204:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782815.403228:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6800/0x6d98ed19b637206 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e52c2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782815.403360:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787782815.403548:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6800/0x6d98ed19b637206 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52c2 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.403563:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3104d6e100) 00010000:00010000:1.0:1787782815.403567:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787782815.403572:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6800/0x6d98ed19b637206 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52c2 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.403587:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6800, rc 0) 00000100:00100000:1.0:1787782815.403661:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+13:9693:x1874625904529024:12345-192.168.202.15@tcp:101:rm.0 Request processed in 496us (758us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1787782815.403670:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:2.0:1787782815.408206:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782815.408849:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904529152 00000100:00100000:3.0:1787782815.408865:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904529152 00000100:00100000:3.0:1787782815.408941:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:3.0:1787782815.408953:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+13:9693:x1874625904529152:12345-192.168.202.15@tcp:37:rm.0 00000100:00100000:3.0:1787782815.413778:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+13:9693:x1874625904529152:12345-192.168.202.15@tcp:37:rm.0 Request processed in 4809us (5571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782815.413796:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:2.0:1787782815.420516:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782815.420712:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904529408 00000100:00100000:1.0:1787782815.420729:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904529408 00000100:00100000:1.0:1787782815.420822:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:1.0:1787782815.420838:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310619d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+13:9693:x1874625904529408:12345-192.168.202.15@tcp:35:rm.0 00000100:00100000:1.0:1787782815.421160:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310619d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+14:9693:x1874625904529408:12345-192.168.202.15@tcp:35:rm.0 Request processed in 326us (776us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787782815.421170:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:2.0:1787782815.423989:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782815.424148:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904529664 00000100:00100000:0.0:1787782815.424162:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904529664 00000100:00100000:0.0:1787782815.424229:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:0.0:1787782815.424241:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+14:9693:x1874625904529664:12345-192.168.202.15@tcp:101:rm.0 00010000:00010000:0.0:1787782815.424288:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782815.424315:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637214 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e52c9 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.424514:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b63721b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.424534:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b63721b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.424548:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b63721b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782815.424581:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787782815.424743:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637214 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52c9 expref: 17 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.424767:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b63721b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52c9 expref: 16 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782815.424777:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c312eeef000) 00010000:00010000:0.0:1787782815.424781:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787782815.424785:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254e00, rc 0) 00000100:00100000:0.0:1787782815.424867:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+16:9693:x1874625904529664:12345-192.168.202.15@tcp:101:rm.0 Request processed in 628us (891us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787782815.424876:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:2.0:1787782815.428193:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782815.428313:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904529792 00000100:00100000:0.0:1787782815.428326:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904529792 00000100:00100000:0.0:1787782815.428527:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:0.0:1787782815.428541:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+16:9693:x1874625904529792:12345-192.168.202.15@tcp:41:rm.0 00000004:00000024:0.0:1787782815.428624:0:5853:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787782815.428721:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+16:9693:x1874625904529792:12345-192.168.202.15@tcp:41:rm.0 Request processed in 182us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782815.428730:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:2.0:1787782815.432072:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782815.432556:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904529920 00000100:00100000:1.0:1787782815.432574:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904529920 00000100:00100000:1.0:1787782815.432730:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:1.0:1787782815.432763:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+16:9693:x1874625904529920:12345-192.168.202.15@tcp:101:rm.0 00010000:00010000:1.0:1787782815.432800:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782815.432824:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6800/0x6d98ed19b637229 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e52d0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.433541:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637230 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.433559:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637230 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.433574:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637230 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.433604:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b637237 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.433613:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b637237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.433746:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b637237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434137:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63723e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434147:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63723e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434155:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63723e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782815.434197:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787782815.434201:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787782815.434219:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63723e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434230:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63723e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434239:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637230 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434244:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637230 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434251:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637230 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434256:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782815.434260:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637230 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434267:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637230 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434279:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c312eeef000) 00010000:00010000:1.0:1787782815.434282:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782815.434287:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637230 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434293:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637230 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434318:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b637237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434324:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b637237 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434330:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b637237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434336:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782815.434339:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b637237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434345:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b637237 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434353:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff8c312eeef200) 00010000:00010000:1.0:1787782815.434356:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782815.434359:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b637237 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.434365:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b637237 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.435779:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6800/0x6d98ed19b637229 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52d0 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.435830:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63723e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52d0 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.435872:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c3104d6e200) 00010000:00010000:1.0:1787782815.435875:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782815.435880:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7600, rc 0) 00000100:00100000:1.0:1787782815.435960:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+17:9693:x1874625904529920:12345-192.168.202.15@tcp:101:rm.0 Request processed in 3201us (3902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782815.435970:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:2.0:1787782815.439357:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782815.439452:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904530176 00000100:00100000:1.0:1787782815.439468:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904530176 00000100:00100000:1.0:1787782815.439542:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:1.0:1787782815.439553:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+17:9693:x1874625904530176:12345-192.168.202.15@tcp:36:rm.0 00010000:00010000:1.0:1787782815.439634:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787782815.439676:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63723e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52d0 expref: 17 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.439701:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b6371ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52b4 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.439716:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c3104d6e200) 00010000:00010000:1.0:1787782815.439741:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6371ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52bb expref: 15 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.439755:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c312eeef000) 00010000:00010000:1.0:1787782815.439758:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787782815.439778:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637245 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.439822:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637245 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.439833:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637245 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.439849:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63724c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.439856:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63724c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.439864:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63724c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.439989:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637253 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.439998:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637253 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.440005:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637253 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787782815.440714:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1787782815.440726:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 300110629459ns, next at 301110627011ns, rc = 0 00010000:00010000:1.0:1787782815.440783:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b63725a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.440793:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b63725a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.440813:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b63725a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.440821:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b63725a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.440829:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b63725a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.440835:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b63725a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.440861:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782815.440880:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637253 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.440888:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637253 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.440895:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637253 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.440902:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782815.440907:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637253 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.440915:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637253 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782815.440926:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782815.440928:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c312eeefd00) 00010000:00010000:1.0:1787782815.440938:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787782815.440943:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b63725a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.440949:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637253 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.440957:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637253 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782815.440986:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7200 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787782815.440994:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b63725a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.441002:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637245 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782815.441008:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b63725a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.441012:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637245 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.441040:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637245 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.441047:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782815.441052:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c312eeefd00) 00010000:00010000:1.0:1787782815.441053:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637245 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.441060:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637245 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.441071:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c312eeef000) 00010000:00010000:2.0:1787782815.441073:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787782815.441081:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782815.441084:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b63725a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.441087:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637245 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782815.441169:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b63725a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.441171:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637245 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787782815.441215:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000151293a7 reply state 00000000bd4585b7 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63724c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782815.441230:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782815.441235:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782815.441239:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782815.441245:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787782815.441357:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+16:9693:x1874625904530176:12345-192.168.202.15@tcp:36:rm.0 Request processed in 1802us (2023us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787782815.441368:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 30 00010000:00010000:3.0:1787782815.445432:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63724c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.445457:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63724c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.445466:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63724c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.445474:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782815.445480:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63724c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.445490:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63724c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.445536:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x2f2003ca (ffff8c312eeefe00) 00010000:00010000:3.0:1787782815.445540:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782815.445547:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63724c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782815.445555:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63724c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x2f2003ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782815.446819:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782815.446888:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904530432 00000100:00100000:3.0:1787782815.446900:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904530432 00000100:00100000:3.0:1787782815.447003:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:3.0:1787782815.447016:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+15:9693:x1874625904530432:12345-192.168.202.15@tcp:35:rm.0 00000100:00100000:1.0:1787782815.447022:0:5854:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1787782815.447046:0:5854:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:3.0:1787782815.447454:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+16:9693:x1874625904530432:12345-192.168.202.15@tcp:35:rm.0 Request processed in 438us (643us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787782815.447465:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:0.0:1787782815.450672:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782815.450783:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904530688 00000100:00100000:1.0:1787782815.450795:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904530688 00000100:00100000:1.0:1787782815.450873:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:1.0:1787782815.450885:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+16:9693:x1874625904530688:12345-192.168.202.15@tcp:36:rm.0 00010000:00010000:1.0:1787782815.450974:0:6719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787782815.451012:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b63721b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52c9 expref: 16 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.451039:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b6371b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52a6 expref: 15 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.451053:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c312eeef000) 00010000:00010000:1.0:1787782815.451073:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b63717a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5298 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.451082:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3104d6e100) 00010000:00010000:1.0:1787782815.451090:0:6719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787782815.451194:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637261 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.451210:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637261 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.451242:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637261 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.451258:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637268 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.451266:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637268 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.451273:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637268 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.451862:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63726f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.451873:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63726f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.451880:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63726f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782815.453902:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787782815.453932:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63726f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.453944:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63726f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.454064:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63726f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.454071:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782815.454085:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63726f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.454518:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63726f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.454543:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c312eeef700) 00010000:00010000:1.0:1787782815.454546:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787782815.454553:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63726f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.454560:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63726f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.454594:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637261 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.454602:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637261 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.454609:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637261 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.454614:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782815.454617:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637261 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.454624:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637261 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.454632:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312eeef200) 00010000:00010000:1.0:1787782815.454634:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782815.454647:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637261 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.454653:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637261 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787782815.454669:0:6719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bd5c844c reply state 000000008219c71e transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637268 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782815.454680:0:6719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787782815.454808:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+15:9693:x1874625904530688:12345-192.168.202.15@tcp:36:rm.0 Request processed in 3919us (4145us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787782815.454820:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 31 00010000:00010000:1.0:1787782815.457535:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637268 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.457553:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637268 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.457563:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637268 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.457570:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782815.457575:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637268 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.457584:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637268 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.457604:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c312eeeff00) 00010000:00010000:1.0:1787782815.457608:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782815.457613:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637268 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782815.457639:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637268 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782816.097248:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782816.270333:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782816.270557:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782816.270755:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904530944 00000100:00100000:1.0:1787782816.270765:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904530944 00000100:00100000:1.0:1787782816.270847:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 106 00000100:00100000:1.0:1787782816.270857:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f38a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2352:x1874625904530944:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782816.271077:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f38a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2352:x1874625904530944:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 108us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782816.271088:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 106 00000100:00080000:0.0:1787782816.271182:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782816.271234:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904530816 00000100:00100000:2.0:1787782816.271239:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904530816 00000100:00100000:3.0:1787782816.271358:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 252 00000100:00100000:3.0:1787782816.271368:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2352:x1874625904530816:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782816.271460:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2352:x1874625904530816:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 93us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782816.271467:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 252 00010000:00010000:1.0:1787782817.122727:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782817.387078:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3141210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922390784:0@lo:400:kworker.0 00000100:00100000:2.0:1787782817.387182:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782817.387242:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3141212d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922391296:0@lo:400:kworker.0 00000100:00100000:2.0:1787782817.387295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782817.387348:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787782817.387355:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3141210b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922390912:0@lo:400:kworker.0 00000100:00100000:2.0:1787782817.387381:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782817.387424:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922391296 00000100:00100000:2.0:1787782817.387433:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922391296 00000100:00100000:2.0:1787782817.387492:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787782817.387501:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922391296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782817.387557:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922391296:12345-0@lo:400:kworker.0 Request processed in 56us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782817.387563:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1787782817.387604:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3141212d00 x1874625922391296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782817.387630:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3141212d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922391296:0@lo:400:kworker.0 00000100:00100000:0.0:1787782817.387782:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3141213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922390656:0@lo:400:kworker.0 00000100:00100000:0.0:1787782817.387821:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782817.387858:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3141212580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922391168:0@lo:400:kworker.0 00000100:00100000:0.0:1787782817.387881:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782817.387903:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787782817.387909:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3141210780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922391040:0@lo:400:kworker.0 00000100:00100000:0.0:1787782817.387930:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787782817.387957:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787782817.387970:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922390784 00000100:00100000:0.0:1787782817.387974:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922390784 00000100:00100000:0.0:1787782817.388001:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922390912 00000100:00100000:0.0:1787782817.388004:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922390912 00000100:00100000:0.0:1787782817.388021:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922391168 00000100:00100000:0.0:1787782817.388024:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922391168 00000100:00100000:0.0:1787782817.388041:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787782817.388047:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922390784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782817.388088:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922390784:12345-0@lo:400:kworker.0 Request processed in 40us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782817.388117:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787782817.388132:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787782817.388138:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922390912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782817.388166:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922390912:12345-0@lo:400:kworker.0 Request processed in 29us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782817.388172:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787782817.388182:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787782817.388189:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f38ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922391168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782817.388219:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f38ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922391168:12345-0@lo:400:kworker.0 Request processed in 31us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782817.388234:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787782817.388252:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922391040 00000100:00100000:0.0:1787782817.388256:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922391040 00000100:00100000:0.0:1787782817.388279:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787782817.388285:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f38a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922391040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782817.388332:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f38a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922391040:12345-0@lo:400:kworker.0 Request processed in 33us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782817.388339:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1787782817.388355:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787782817.388358:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782817.388379:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3141210b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922390912:0@lo:400:kworker.0 00000100:00100000:0.0:1787782817.388398:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3141210000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922390784:0@lo:400:kworker.0 00010000:00080000:0.0:1787782817.388424:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c3141210780 x1874625922391040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782817.388434:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3141210780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922391040:0@lo:400:kworker.0 00000100:00100000:0.0:1787782817.388442:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3141212580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922391168:0@lo:400:kworker.0 00000100:00100000:2.0:1787782817.388682:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922390656 00000100:00100000:2.0:1787782817.388688:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922390656 00000100:00100000:2.0:1787782817.388724:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787782817.388731:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922390656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782817.388769:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922390656:12345-0@lo:400:kworker.0 Request processed in 39us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782817.388776:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787782817.388982:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3141213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922390656:0@lo:400:kworker.0 00000100:00100000:0.0:1787782817.889683:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782817.889707:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922391424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782817.889784:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782817.889856:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922391424 00000100:00100000:0.0:1787782817.889863:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922391424 00000100:00100000:0.0:1787782817.889914:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787782817.889924:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccdad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922391424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787782817.889978:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782817.890024:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccdad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922391424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782817.890031:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787782817.890072:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c313ccda1c0 x1874625922391424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782817.890091:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922391424:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1787782817.890904:0:6959:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 302560806628ns, next at 303560803737ns, rc = 0 00000100:00100000:2.0:1787782817.890922:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787782817.890934:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922391552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787782817.890972:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782817.891016:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922391552 00000100:00100000:2.0:1787782817.891021:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922391552 00000100:00100000:2.0:1787782817.891053:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787782817.891060:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922391552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787782817.891085:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787782817.891160:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922391552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782817.891167:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1787782817.891210:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c313c97f0c0 x1874625922391552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782817.891226:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922391552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787782818.148291:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782819.183335:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782819.279922:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782819.280011:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904531072 00000100:00100000:1.0:1787782819.280021:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904531072 00000100:00100000:1.0:1787782819.280077:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 254 00000100:00100000:1.0:1787782819.280086:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2351:x1874625904531072:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782819.280184:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2351:x1874625904531072:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 99us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782819.280193:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 254 00000100:00100000:2.0:1787782819.284208:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782819.284253:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782819.284278:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782819.284312:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904531200 00000100:00100000:2.0:1787782819.284322:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904531200 00000100:00100000:2.0:1787782819.284411:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904531456 00000100:00100000:2.0:1787782819.284415:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904531456 00000100:00100000:2.0:1787782819.284442:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 110 00000100:00100000:2.0:1787782819.284451:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+14:2351:x1874625904531200:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782819.284546:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+14:2351:x1874625904531200:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 95us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782819.284554:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 110 00000100:00100000:2.0:1787782819.284572:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 111 00000100:00100000:2.0:1787782819.284579:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2351:x1874625904531456:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782819.284604:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2351:x1874625904531456:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 26us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782819.284611:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 111 00000100:00080000:2.0:1787782819.284626:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782819.284866:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904531328 00000100:00100000:1.0:1787782819.284871:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904531328 00000100:00100000:1.0:1787782819.284909:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:1.0:1787782819.284916:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2351:x1874625904531328:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782819.284946:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2351:x1874625904531328:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 30us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782819.284965:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00080000:1.0:1787782819.284989:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1787782819.970637:0:11626:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1787782820.194223:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787782820.522937:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:3.0:1787782820.523063:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1787782820.523073:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:3.0:1787782820.523150:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:3.0:1787782820.523462:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922391680:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787782820.523541:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782820.523626:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922391680 00000100:00100000:0.0:1787782820.523633:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922391680 00000100:00100000:0.0:1787782820.523690:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787782820.523699:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922391680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787782820.523726:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787782820.523760:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8f669f, atime: 0x6a8f669f, ctime: 0x6a8f669f, blocks: 0x1 00010000:00010000:0.0:1787782820.523769:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a7a645c/0x6d98ed19b637276 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782820.523786:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=305s v=(0 0) 00010000:00010000:0.0:1787782820.523790:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782820.523797:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a7a645c/0x6d98ed19b637276 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782820.523816:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a7a645c/0x6d98ed19b637276 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782820.523934:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a7a645c/0x6d98ed19b637276 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782820.523949:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a7a645c/0x6d98ed19b637276 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782820.524002:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1787782820.524117:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787782820.524633:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625922391680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 933us (1090us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787782820.524641:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1787782820.524812:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c313ccda1c0/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787782820.524820:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922391680:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787782820.525044:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782820.525052:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a7a645c/0x6d98ed19b637276 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782820.525061:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255200 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787782820.525066:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a7a645c/0x6d98ed19b637276 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782820.525077:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a7a645c/0x6d98ed19b637276 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782820.525912:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a7a645c/0x6d98ed19b637276 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782820.525924:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a7a645c/0x6d98ed19b637276 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782820.525946:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782820.525948:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782820.525950:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782821.217306:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787782821.233882:0:11676:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8deb1070 20000000:00000080:2.0:1787782821.233901:0:11676:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c3137e3e800 uarg=0000000000000000 20000000:01000000:2.0:1787782821.233939:0:11676:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787782821.233946:0:11676:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787782821.233951:0:11676:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787782821.234762:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787782821.234965:0:11676:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787782821.243750:0:11676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787782821.243796:0:11676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787782821.243875:0:11676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787782821.243895:0:11676:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787782821.243915:0:11676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c312f294400/0x6d98ed19b63727d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.243933:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c312f295a00/0x6d98ed19b63711f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b637118 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.243942:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3141254200/0x6d98ed19b63712d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b637126 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.243949:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31421fce00/0x6d98ed19b63713b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b637134 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.243958:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31421fd800/0x6d98ed19b637142 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5283 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.243965:0:11676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c312f294000/0x6d98ed19b637149 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e528a expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.243973:0:11676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c312f294400/0x6d98ed19b63727d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.244017:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c312f294000/0x6d98ed19b637149 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e528a expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.244033:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c312f294000/0x6d98ed19b637149 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e528a expref: 12 pid: 5845 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782821.244050:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625922391808:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787782821.244518:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31421fd800/0x6d98ed19b637142 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5283 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.244536:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c31421fd800/0x6d98ed19b637142 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5283 expref: 12 pid: 5845 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782821.244546:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625922391936:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787782821.244582:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31421fce00/0x6d98ed19b63713b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b637134 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.244589:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c31421fce00/0x6d98ed19b63713b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b637134 expref: 18 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782821.244598:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625922392064:0@lo:104: 00000100:00100000:2.0:1787782821.244642:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787782821.244678:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3141254200/0x6d98ed19b63712d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b637126 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.244686:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c3141254200/0x6d98ed19b63712d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b637126 expref: 18 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782821.244694:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625922392192:0@lo:104: 00000100:00100000:2.0:1787782821.244714:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782821.244742:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922392064 00000100:00100000:2.0:1787782821.244748:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922392064 00000100:00100000:2.0:1787782821.244781:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922392192 00000100:00100000:2.0:1787782821.244783:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922392192 00000100:00100000:2.0:1787782821.244798:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787782821.244805:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+4:11676:x1874625922392064:12345-0@lo:104: 00010000:00010000:2.0:1787782821.244824:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b637134 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b63713b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.244880:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787782821.244885:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+4:11676:x1874625922392064:12345-0@lo:104: Request processed in 81us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782821.244893:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787782821.244913:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787782821.244918:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+3:11676:x1874625922392192:12345-0@lo:104: 00010000:00010000:2.0:1787782821.244925:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b637126 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b63712d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.244953:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787782821.244957:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+3:11676:x1874625922392192:12345-0@lo:104: Request processed in 39us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782821.244961:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1787782821.244975:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787782821.244980:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b637134 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b63713b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.244987:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:2.0:1787782821.244990:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b637134 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b63713b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.244998:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b637134 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b63713b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782821.245004:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b637134 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b63713b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782821.245009:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787782821.245040:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b637134 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b63713b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.245046:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782821.245062:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b637134 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b63713b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.245068:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31013a1c00/0x6d98ed19b637134 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b63713b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.245080:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782821.245083:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b637126 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b63712d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.245089:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fc800 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:2.0:1787782821.245092:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b637126 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b63712d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.245118:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b637126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b63712d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782821.245124:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b637126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b63712d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782821.245129:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787782821.245142:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b637126 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b63712d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.245148:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782821.245153:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b637126 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b63712d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.245170:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31421fc800/0x6d98ed19b637126 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b63712d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.245180:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782821.245182:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782821.245184:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782821.245202:0:11676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c312f295a00/0x6d98ed19b63711f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b637118 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.245211:0:11676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c312f295a00/0x6d98ed19b63711f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b637118 expref: 18 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782821.245220:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625922392576:0@lo:104: 00000100:00100000:2.0:1787782821.245244:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782821.245269:0:5833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787782821.245278:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922392576 00000100:00100000:2.0:1787782821.245281:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922392576 00000100:00100000:0.0:1787782821.245393:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922392320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782821.245422:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782821.245447:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782821.245452:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922392448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782821.245468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782821.245490:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922392320 00000100:00100000:0.0:1787782821.245493:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922392320 00010000:00010000:0.0:1787782821.245512:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31421fce00/0x6d98ed19b63713b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b637134 expref: 19 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782821.245529:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922392448 00000100:00100000:0.0:1787782821.245531:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922392448 00010000:00010000:0.0:1787782821.245540:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3141254200/0x6d98ed19b63712d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b637126 expref: 20 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782821.245553:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787782821.245559:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db359560-8e1a-42c0-a155-5e020d83d9a3+20:3306:x1874625922392320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787782821.245567:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782821.245579:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31421fce00/0x6d98ed19b63713b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b637134 expref: 20 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782821.245589:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31421fce00/0x6d98ed19b63713b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b637134 expref: 20 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782821.245603:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782821.245627:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db359560-8e1a-42c0-a155-5e020d83d9a3+20:3306:x1874625922392320:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782821.245633:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787782821.245646:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787782821.245652:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922392448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787782821.245660:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782821.245663:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3141254200/0x6d98ed19b63712d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b637126 expref: 19 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782821.245671:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3141254200/0x6d98ed19b63712d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b637126 expref: 19 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782821.245679:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782821.245699:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922392448:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782821.245704:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787782821.245759:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922392448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782821.245766:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922392320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782821.245826:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787782821.245832:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3001e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+3:11676:x1874625922392576:12345-0@lo:104: 00010000:00010000:2.0:1787782821.245840:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c3141255400/0x6d98ed19b637118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b63711f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.245881:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787782821.245886:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3001e7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+3:11676:x1874625922392576:12345-0@lo:104: Request processed in 55us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782821.245892:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787782821.245929:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31342f8300 going to sleep for 11 seconds 00010000:00010000:2.0:1787782821.245942:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31421fce00/0x6d98ed19b63713b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b637134 expref: 18 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782821.245959:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625922392064:0@lo:104: 00010000:00010000:2.0:1787782821.245969:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3141254200/0x6d98ed19b63712d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b637126 expref: 17 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782821.245977:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625922392192:0@lo:104: 00000100:00100000:2.0:1787782821.245983:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97e940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625922392576:0@lo:104: 00010000:00010000:2.0:1787782821.246007:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782821.246012:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3141255400/0x6d98ed19b637118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b63711f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.246018:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255400 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:2.0:1787782821.246021:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3141255400/0x6d98ed19b637118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b63711f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.246029:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3141255400/0x6d98ed19b637118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b63711f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787782821.246037:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3141255400/0x6d98ed19b637118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b63711f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782821.246043:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787782821.246058:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3141255400/0x6d98ed19b637118 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b63711f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.246063:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787782821.246074:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3141255400/0x6d98ed19b637118 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b63711f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.246091:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3141255400/0x6d98ed19b637118 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b63711f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782821.246132:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782821.246134:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782821.246136:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782821.246559:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782821.247274:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922392704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787782821.247394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782821.247515:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922392704 00000100:00100000:0.0:1787782821.247521:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922392704 00010000:00010000:0.0:1787782821.247556:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c312f295a00/0x6d98ed19b63711f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b637118 expref: 17 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782821.247621:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787782821.247629:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102e11450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db359560-8e1a-42c0-a155-5e020d83d9a3+17:3304:x1874625922392704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787782821.247640:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782821.247645:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c312f295a00/0x6d98ed19b63711f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b637118 expref: 17 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782821.247655:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c312f295a00/0x6d98ed19b63711f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b637118 expref: 17 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782821.247668:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c312f295a00/0x6d98ed19b63711f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b637118 expref: 17 pid: 5845 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782821.247682:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782821.247719:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102e11450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db359560-8e1a-42c0-a155-5e020d83d9a3+16:3304:x1874625922392704:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782821.247725:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787782821.247809:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922392704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782821.259910:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782821.259954:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782821.260029:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904531584 00000100:00100000:1.0:1787782821.260038:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904531584 00010000:00010000:1.0:1787782821.260077:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c312f294000/0x6d98ed19b637149 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e528a expref: 13 pid: 5845 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782821.260138:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904531712 00000100:00100000:1.0:1787782821.260142:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904531712 00010000:00010000:1.0:1787782821.260156:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31421fd800/0x6d98ed19b637142 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5283 expref: 14 pid: 5845 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782821.260180:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:1.0:1787782821.260189:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ceacfe35-7480-471c-a7cd-7a05a1613220+14:2350:x1874625904531584:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782821.260205:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782821.260211:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c312f294000/0x6d98ed19b637149 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e528a expref: 14 pid: 5845 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782821.260222:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c312f294000/0x6d98ed19b637149 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e528a expref: 14 pid: 5845 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782821.260257:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782821.260320:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ceacfe35-7480-471c-a7cd-7a05a1613220+14:2350:x1874625904531584:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 132us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782821.260328:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:1.0:1787782821.260347:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:1.0:1787782821.260362:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2349:x1874625904531712:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782821.260371:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782821.260375:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31421fd800/0x6d98ed19b637142 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5283 expref: 13 pid: 5845 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782821.260385:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31421fd800/0x6d98ed19b637142 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5283 expref: 13 pid: 5845 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782821.260397:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c312f294400/0x6d98ed19b63727d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782821.260406:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c312f294400/0x6d98ed19b63727d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782821.260421:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c312f294400/0x6d98ed19b63727d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782821.260428:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c312f294400/0x6d98ed19b63727d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782821.260436:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c312f294400/0x6d98ed19b63727d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782821.260443:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c312f294400/0x6d98ed19b63727d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782821.260456:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f294400 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782821.260460:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c312f294400/0x6d98ed19b63727d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782821.260468:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c312f294400/0x6d98ed19b63727d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782821.260476:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c312f294400/0x6d98ed19b63727d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782821.260486:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782821.260504:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2349:x1874625904531712:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 151us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782821.260510:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 34 00010000:00010000:0.0:1787782821.264181:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c312f294000/0x6d98ed19b637149 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e528a expref: 12 pid: 5845 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782821.264204:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625922391808:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782821.264313:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31421fd800/0x6d98ed19b637142 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5283 expref: 11 pid: 5845 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782821.264326:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11676:1874625922391936:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782821.264374:0:11676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c312f294400/0x6d98ed19b63727d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782821.264386:0:11676:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c312f294400/0x6d98ed19b63727d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782821.264393:0:11676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c312f294400/0x6d98ed19b63727d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782821.264399:0:11676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c312f294400/0x6d98ed19b63727d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782822.241594:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782822.497743:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31412112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922392832:0@lo:400:kworker.0 00000100:00100000:2.0:1787782822.497820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782822.497907:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3141213c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874625922393088:0@lo:400:kworker.0 00000100:00100000:2.0:1787782822.497935:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782822.497954:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787782822.497960:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3141211680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922392960:0@lo:400:kworker.0 00000100:00100000:2.0:1787782822.497978:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782822.498006:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922393088 00000100:00100000:2.0:1787782822.498013:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922393088 00000100:00100000:2.0:1787782822.498156:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922392960 00000100:00100000:2.0:1787782822.498160:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922392960 00000100:00100000:2.0:1787782822.498178:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787782822.498185:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874625922393088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782822.498233:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874625922393088:12345-0@lo:400:kworker.0 Request processed in 48us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782822.498240:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787782822.498256:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787782822.498430:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922392832 00000100:00100000:0.0:1787782822.498434:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922392832 00000100:00100000:0.0:1787782822.498462:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787782822.498468:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+16:3305:x1874625922392832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782822.498509:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+16:3305:x1874625922392832:12345-0@lo:400:kworker.0 Request processed in 41us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782822.498525:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787782822.498585:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31412112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922392832:0@lo:400:kworker.0 00000100:00100000:1.0:1787782822.498754:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3141212940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922393344:0@lo:400:kworker.0 00000100:00100000:1.0:1787782822.498782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782822.498797:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787782822.498801:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3141213840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922393216:0@lo:400:kworker.0 00000100:00100000:1.0:1787782822.498824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782822.498849:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922393216 00000100:00100000:1.0:1787782822.498853:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922393216 00000100:00100000:1.0:1787782822.498881:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787782822.498888:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31412103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625922393216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782822.498923:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31412103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625922393216:12345-0@lo:400:kworker.0 Request processed in 37us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782822.498929:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787782822.498958:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3141213840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922393216:0@lo:400:kworker.0 00000100:00100000:1.0:1787782822.498979:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31412121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922393472:0@lo:400:kworker.0 00000100:00100000:1.0:1787782822.499001:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782822.499046:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922393472 00000100:00100000:1.0:1787782822.499051:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922393472 00000100:00100000:1.0:1787782822.499078:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787782822.499084:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141213840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922393472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782822.499140:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141213840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922393472:12345-0@lo:400:kworker.0 Request processed in 56us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782822.499146:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1787782822.499171:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31412121c0 x1874625922393472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782822.499196:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31412121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922393472:0@lo:400:kworker.0 00000100:00080000:1.0:1787782822.499232:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787782822.499236:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782822.499239:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782822.499254:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922393344 00000100:00100000:1.0:1787782822.499258:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922393344 00000100:00100000:2.0:1787782822.499418:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922392960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782822.499455:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922392960:12345-0@lo:400:kworker.0 Request processed in 40us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782822.499541:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3141211680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922392960:0@lo:400:kworker.0 00000100:00100000:3.0:1787782822.499563:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3141213c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874625922393088:0@lo:400:kworker.0 00000100:00080000:0.0:1787782822.503568:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782822.505757:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787782822.505781:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31412112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922393344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782822.505892:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31412112c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922393344:12345-0@lo:400:kworker.0 Request processed in 124us (7108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782822.505901:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787782822.506204:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3141212940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922393344:0@lo:400:kworker.0 00000100:00100000:2.0:1787782822.511910:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787782823.009470:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922393600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782823.009543:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782823.009663:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922393600 00000100:00100000:3.0:1787782823.009672:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922393600 00000100:00100000:3.0:1787782823.009725:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787782823.009734:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922393600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787782823.009782:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782823.009838:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccd92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922393600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782823.009846:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1787782823.009885:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c313c94d680 x1874625922393600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782823.009903:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922393600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782823.012439:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3141212940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922393728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782823.013139:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782823.013333:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922393728 00000100:00100000:1.0:1787782823.013352:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922393728 00000100:00100000:1.0:1787782823.013406:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787782823.013417:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625922393728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782823.013454:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782823.013517:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625922393728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782823.013524:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787782823.013617:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3141212940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922393728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782823.053562:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782823.056799:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904531840 00000100:00100000:2.0:1787782823.056815:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904531840 00000100:00100000:2.0:1787782823.056888:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 256 00000100:00100000:2.0:1787782823.056898:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31091ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+11:5590:x1874625904531840:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782823.056913:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782823.056932:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c312f294a00/0x6d98ed19b637284 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e52d7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782823.056959:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c312f294a00/0x6d98ed19b637284 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52d7 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782823.056970:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c312f294a00/0x6d98ed19b637284 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52d7 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782823.056979:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312f294a00, rc 0) 00000100:00100000:2.0:1787782823.057056:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31091ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+12:5590:x1874625904531840:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 159us (3507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782823.057062:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 256 00000100:00100000:1.0:1787782823.061880:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782823.061982:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904531968 00000100:00100000:0.0:1787782823.061992:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904531968 00000100:00100000:0.0:1787782823.062048:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 257 00000100:00100000:0.0:1787782823.062057:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31091b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+12:5590:x1874625904531968:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782823.062409:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31091b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+12:5590:x1874625904531968:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 352us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782823.062417:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 257 00000100:00100000:1.0:1787782823.065209:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782823.065732:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904532096 00000100:00100000:0.0:1787782823.065743:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904532096 00000100:00100000:0.0:1787782823.065806:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 258 00000100:00100000:0.0:1787782823.065816:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31091b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+12:5590:x1874625904532096:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782823.066045:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31091b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+12:5590:x1874625904532096:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 229us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782823.066061:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 258 00000100:00100000:3.0:1787782823.074863:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782823.075675:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904532224 00000100:00100000:2.0:1787782823.075696:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904532224 00000100:00100000:2.0:1787782823.075756:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 259 00000100:00100000:2.0:1787782823.075767:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31091b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+12:9964:x1874625904532224:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787782823.076028:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31091b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+12:9964:x1874625904532224:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 262us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782823.076042:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 259 00000100:00100000:2.0:1787782823.092412:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782823.092644:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904532352 00000100:00100000:1.0:1787782823.092655:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904532352 00000100:00100000:1.0:1787782823.092789:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 260 00000100:00100000:1.0:1787782823.092802:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+12:9964:x1874625904532352:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787782823.094685:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109177850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+12:9964:x1874625904532352:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 1877us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782823.094708:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 260 00000100:00100000:2.0:1787782823.102972:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782823.103185:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904532480 00000100:00100000:0.0:1787782823.103202:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904532480 00000100:00100000:0.0:1787782823.103274:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 261 00000100:00100000:0.0:1787782823.103286:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+12:5590:x1874625904532480:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782823.103303:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782823.103321:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141254a00/0x6d98ed19b63728b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e52de expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782823.103364:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141254a00/0x6d98ed19b63728b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52de expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782823.103377:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141254a00/0x6d98ed19b63728b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52de expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782823.103386:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254a00, rc 0) 00000100:00100000:0.0:1787782823.103459:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109174450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:5590:x1874625904532480:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 175us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782823.103467:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 261 00000100:00100000:3.0:1787782823.106022:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782823.106227:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904532608 00000100:00100000:1.0:1787782823.106248:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904532608 00000100:00100000:1.0:1787782823.106320:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 262 00000100:00100000:1.0:1787782823.106331:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:5590:x1874625904532608:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782823.106857:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109176850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:5590:x1874625904532608:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 526us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782823.106864:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 262 00000100:00100000:1.0:1787782823.129173:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782823.129415:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904532736 00000100:00100000:2.0:1787782823.129425:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904532736 00000100:00100000:2.0:1787782823.129489:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 263 00000100:00100000:2.0:1787782823.129500:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:5590:x1874625904532736:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782823.129751:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109174850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:5590:x1874625904532736:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 252us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782823.129760:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 263 10000000:01000000:1.0:1787782823.137223:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787782823.137232:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c310712b000 from 7 10000000:01000000:1.0:1787782823.137237:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787782823.137301:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782823.137313:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782823.137325:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782823.137361:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31412121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922393856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787782823.137438:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782823.137519:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911c540 going to sleep for 11 seconds 00000100:00100000:0.0:1787782823.137660:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922393856 00000100:00100000:0.0:1787782823.137668:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922393856 00000100:00100000:0.0:1787782823.137721:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787782823.137730:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:5848:x1874625922393856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782823.137741:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782823.137753:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141255400/0x6d98ed19b637299 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b637292 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782823.137795:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141255400/0x6d98ed19b637299 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b637292 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782823.137806:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141255400/0x6d98ed19b637299 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b637292 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782823.137815:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255400, rc 0) 00000100:00100000:0.0:1787782823.137857:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109175450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922393856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782823.137864:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787782823.138161:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31412121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922393856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782823.138177:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637299 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782823.138186:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b637299 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782823.138362:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31412121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922393984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782823.138392:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782823.138475:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911c540 going to sleep for 11 seconds 00000100:00100000:3.0:1787782823.143823:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922393984 00000100:00100000:3.0:1787782823.143839:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922393984 00000100:00100000:3.0:1787782823.143908:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787782823.143919:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922393984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782823.144807:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109174c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922393984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 887us (6410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782823.144818:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787782823.144923:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31412121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922393984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782823.144993:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31412121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922394112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787782823.145045:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782823.145083:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787782823.145298:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922394112 00000100:00100000:2.0:1787782823.145304:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922394112 00000100:00100000:2.0:1787782823.145350:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787782823.145357:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922394112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782823.145520:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109175850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922394112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782823.145528:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787782823.145752:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31412121c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922394112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787782823.146320:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782823.146647:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904532864 00000100:00100000:2.0:1787782823.146653:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904532864 00000100:00100000:2.0:1787782823.146705:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 267 00000100:00100000:2.0:1787782823.146714:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:9967:x1874625904532864:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787782823.146898:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109177450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:9967:x1874625904532864:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 185us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782823.146912:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 267 00000100:00100000:3.0:1787782823.147900:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:11689:1874625922394240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782823.148164:0:11689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782823.148297:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922394240 00000100:00100000:1.0:1787782823.148303:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922394240 00000100:00100000:1.0:1787782823.148347:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787782823.148355:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:11689:x1874625922394240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787782823.148537:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109177050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:11689:x1874625922394240:12345-0@lo:502:llog_process_th.0 Request processed in 183us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782823.148545:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787782823.148774:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d0c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787782823.148796:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:11689:1874625922394240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787782823.148826:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782823.148835:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782823.148837:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787782823.148850:0:11689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c310712b000 00000020:00000080:3.0:1787782823.148853:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787782823.148928:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:11689:1874625922394368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782823.149382:0:11689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782823.149464:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d0c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787782823.159866:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782823.177825:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922394368 00000100:00100000:2.0:1787782823.177843:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922394368 00000100:00100000:2.0:1787782823.177906:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904532992 00000100:00100000:2.0:1787782823.177910:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904532992 00000100:00100000:2.0:1787782823.177931:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787782823.177941:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+17:11689:x1874625922394368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782823.178468:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 270 00000100:00100000:3.0:1787782823.178481:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:9967:x1874625904532992:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787782823.186175:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109175050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:9967:x1874625904532992:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 7683us (26304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782823.186191:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 270 00000100:00100000:2.0:1787782823.189287:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109175c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+17:11689:x1874625922394368:12345-0@lo:502:llog_process_th.0 Request processed in 11338us (39895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782823.189302:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787782823.189561:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:11689:1874625922394368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787782823.189598:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782823.189607:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782823.189610:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787782823.189615:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787782823.189778:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787782823.189804:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787782823.189818:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637299 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782823.189828:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637299 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782823.189838:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787782823.189840:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3129b5d800 from 7 10000000:01000000:1.0:1787782823.189843:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787782823.189889:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782823.189907:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782823.189917:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782823.189938:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3141213480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922394496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787782823.189978:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782823.190021:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911c540 going to sleep for 11 seconds 00000040:00080000:1.0:1787782823.191170:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787782823.192530:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922394496 00000100:00100000:2.0:1787782823.192542:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922394496 00000100:00100000:2.0:1787782823.192606:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787782823.192617:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+17:5848:x1874625922394496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782823.192634:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782823.192653:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c312f294600/0x6d98ed19b6372a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b6372a0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782823.192680:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c312f294600/0x6d98ed19b6372a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b6372a0 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782823.192703:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c312f294600/0x6d98ed19b6372a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6372a0 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782823.192712:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312f294600, rc 0) 00000100:00100000:2.0:1787782823.192788:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109174050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922394496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782823.192807:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787782823.192856:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3141213480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922394496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782823.192875:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6372a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782823.192884:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b6372a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782823.192967:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922394624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782823.193003:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782823.193033:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31342f8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787782823.193053:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922394624 00000100:00100000:2.0:1787782823.193057:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922394624 00000100:00100000:2.0:1787782823.193075:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787782823.193080:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922394624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782823.194667:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109176450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922394624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1580us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782823.194678:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787782823.194679:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922394624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787782823.194724:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922394752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782823.194788:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782823.194823:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d0c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787782823.195174:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922394752 00000100:00100000:3.0:1787782823.195180:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922394752 00000100:00100000:3.0:1787782823.195231:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787782823.195240:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922394752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787782823.195410:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109176050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922394752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782823.195417:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787782823.195899:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922394752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782823.199306:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:11693:1874625922394880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782823.199398:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782823.199441:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c313455d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787782823.200032:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922394880 00000100:00100000:0.0:1787782823.200040:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922394880 00000100:00100000:0.0:1787782823.200118:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1787782823.200129:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+18:11693:x1874625922394880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782823.200377:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109176c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+18:11693:x1874625922394880:12345-0@lo:502:llog_process_th.0 Request processed in 249us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782823.200385:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787782823.200671:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:11693:1874625922394880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787782823.200708:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782823.200718:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782823.200720:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787782823.200726:0:11693:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c3129b5d800 00000020:00000080:2.0:1787782823.200728:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787782823.200809:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:11693:1874625922395008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782823.200866:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782823.200896:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c313455d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787782823.201129:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922395008 00000100:00100000:3.0:1787782823.201134:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922395008 00000100:00100000:3.0:1787782823.201163:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1787782823.201170:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:11693:x1874625922395008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782823.201352:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109177c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:11693:x1874625922395008:12345-0@lo:502:llog_process_th.0 Request processed in 181us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782823.201359:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787782823.201490:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:11693:1874625922395008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787782823.201513:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782823.201518:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782823.201520:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787782823.201524:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787782823.201668:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787782823.201687:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787782823.201696:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6372a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782823.201706:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6372a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782823.201715:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787782823.201718:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c311846c800 from 7 10000000:01000000:3.0:1787782823.201720:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787782823.201745:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782823.201753:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782823.201762:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782823.201775:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922395136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787782823.201804:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782823.201822:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d0c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782823.204265:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922395136 00000100:00100000:2.0:1787782823.204276:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922395136 00000100:00100000:2.0:1787782823.204326:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787782823.204348:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+18:5848:x1874625922395136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782823.204367:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782823.204387:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c312f294c00/0x6d98ed19b6372b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b6372ae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782823.204418:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c312f294c00/0x6d98ed19b6372b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b6372ae expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782823.204429:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c312f294c00/0x6d98ed19b6372b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6372ae expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782823.204438:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312f294c00, rc 0) 00000100:00100000:2.0:1787782823.204518:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922395136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (2713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782823.204525:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787782823.204569:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922395136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782823.204587:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6372b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782823.204596:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b6372b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782823.204661:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922395264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782823.204697:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782823.204725:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c313455d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787782823.204739:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922395264 00000100:00100000:2.0:1787782823.204743:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922395264 00000100:00100000:2.0:1787782823.204763:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787782823.204769:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922395264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782823.205010:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922395264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782823.205017:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1787782823.205048:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922395264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782823.205076:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922395392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782823.205138:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782823.205151:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c313455d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787782823.205161:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922395392 00000100:00100000:2.0:1787782823.205164:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922395392 00000100:00100000:2.0:1787782823.205184:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787782823.205189:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922395392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782823.205317:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:5848:x1874625922395392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782823.205324:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787782823.205371:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:db359560-8e1a-42c0-a155-5e020d83d9a3:5848:1874625922395392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782823.207919:0:11695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:11695:1874625922395520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782823.208004:0:11695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782823.208047:0:11695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c313455d600 going to sleep for 11 seconds 00000100:00100000:3.0:1787782823.208119:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922395520 00000100:00100000:3.0:1787782823.208126:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922395520 00000100:00100000:3.0:1787782823.208171:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787782823.208180:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:11695:x1874625922395520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782823.208412:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:11695:x1874625922395520:12345-0@lo:502:llog_process_th.0 Request processed in 232us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782823.208420:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1787782823.212562:0:11695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:11695:1874625922395520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787782823.212609:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782823.212621:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782823.212625:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787782823.212632:0:11695:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c311846c800 00000020:00000080:2.0:1787782823.212635:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787782823.212728:0:11695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:11695:1874625922395648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782823.212798:0:11695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782823.212843:0:11695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3103ed4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782823.213643:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922395648 00000100:00100000:0.0:1787782823.213651:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922395648 00000100:00100000:0.0:1787782823.213704:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787782823.213713:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:11695:x1874625922395648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782823.213933:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:11695:x1874625922395648:12345-0@lo:502:llog_process_th.0 Request processed in 221us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782823.213962:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1787782823.214154:0:11695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97e940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:db359560-8e1a-42c0-a155-5e020d83d9a3:11695:1874625922395648:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787782823.214181:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782823.214188:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782823.214190:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787782823.214195:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787782823.218740:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787782823.218776:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787782823.218788:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6372b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782823.218801:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6372b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782823.265581:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787782824.225810:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787782824.290648:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782824.462545:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782824.462582:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782824.462622:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782824.462664:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782824.462778:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904533248 00000100:00100000:0.0:1787782824.462787:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904533248 00000100:00100000:0.0:1787782824.462854:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904533504 00000100:00100000:0.0:1787782824.462857:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904533504 00000100:00100000:0.0:1787782824.462879:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:0.0:1787782824.462890:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141210780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2352:x1874625904533248:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782824.462992:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141210780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2352:x1874625904533248:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 104us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782824.463001:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:0.0:1787782824.463018:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:0.0:1787782824.463025:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2352:x1874625904533504:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782824.463050:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904533376 00000100:00100000:0.0:1787782824.463050:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141210000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2352:x1874625904533504:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 26us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782824.463054:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904533376 00000100:00100000:0.0:1787782824.463056:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:0.0:1787782824.463089:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904533120 00000100:00100000:0.0:1787782824.463092:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904533120 00000100:00100000:2.0:1787782824.463122:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:2.0:1787782824.463128:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141212580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2352:x1874625904533376:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782824.463139:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 281 00000100:00100000:0.0:1787782824.463144:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2352:x1874625904533120:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782824.463156:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141212580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2352:x1874625904533376:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 29us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782824.463162:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:0.0:1787782824.463163:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2352:x1874625904533120:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 19us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782824.463168:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 281 00000100:00080000:1.0:1787782824.464436:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782824.464445:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787782825.314792:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787782825.686060:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1787782826.337758:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782827.362444:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782827.617533:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccdb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922395776:0@lo:400:kworker.0 00000100:00100000:1.0:1787782827.617617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782827.617682:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922396288:0@lo:400:kworker.0 00000100:00100000:1.0:1787782827.617709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782827.617737:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787782827.617743:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922396160:0@lo:400:kworker.0 00000100:00100000:1.0:1787782827.617768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782827.617813:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922396288 00000100:00100000:1.0:1787782827.617821:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922396288 00000100:00100000:0.0:1787782827.618241:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922395776 00000100:00100000:0.0:1787782827.618253:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922395776 00000100:00100000:0.0:1787782827.618305:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787782827.618314:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922395776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782827.618372:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922395776:12345-0@lo:400:kworker.0 Request processed in 59us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782827.618378:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787782827.618424:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922396160 00000100:00100000:0.0:1787782827.618428:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922396160 00000100:00100000:0.0:1787782827.618464:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787782827.618471:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141212d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922396160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782827.618514:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141212d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922396160:12345-0@lo:400:kworker.0 Request processed in 44us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782827.618521:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1787782827.618537:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787782827.618573:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1787782827.618578:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c313ccda1c0, transno 4294967300 00000100:00100000:0.0:1787782827.618589:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccdbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922396160:0@lo:400:kworker.0 00000100:00100000:0.0:1787782827.618599:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccdb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922395776:0@lo:400:kworker.0 00000100:00100000:1.0:1787782827.619306:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787782827.619316:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141210b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922396288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782827.619374:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141210b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922396288:12345-0@lo:400:kworker.0 Request processed in 60us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782827.619381:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787782827.619417:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922396288:0@lo:400:kworker.0 00000100:00100000:2.0:1787782827.619701:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccd8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922395904:0@lo:400:kworker.0 00000100:00100000:2.0:1787782827.619740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782827.619762:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922396416:0@lo:400:kworker.0 00000100:00100000:2.0:1787782827.619782:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782827.619798:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787782827.619804:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922396032:0@lo:400:kworker.0 00000100:00100000:2.0:1787782827.619838:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782827.619883:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922395904 00000100:00100000:2.0:1787782827.619888:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922395904 00000100:00100000:2.0:1787782827.619926:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922396032 00000100:00100000:2.0:1787782827.619929:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922396032 00000100:00100000:2.0:1787782827.619949:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787782827.619955:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922395904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782827.619991:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922395904:12345-0@lo:400:kworker.0 Request processed in 36us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782827.619997:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1787782827.620010:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787782827.620015:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922396032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782827.620043:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922396032:12345-0@lo:400:kworker.0 Request processed in 25us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782827.620062:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787782827.620081:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922396416 00000100:00100000:2.0:1787782827.620084:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922396416 00000100:00100000:2.0:1787782827.620133:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787782827.620139:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922396416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782827.620168:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922396416:12345-0@lo:400:kworker.0 Request processed in 30us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782827.620173:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787782827.620205:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccd8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922396032:0@lo:400:kworker.0 00000100:00100000:2.0:1787782827.620214:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccd8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922395904:0@lo:400:kworker.0 00010000:00080000:2.0:1787782827.620225:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31070ff840 x1874625922396416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782827.620234:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922396416:0@lo:400:kworker.0 00000100:00080000:0.0:1787782827.622842:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787782827.622853:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782828.129370:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922396544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787782828.129447:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782828.129545:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922396544 00000100:00100000:2.0:1787782828.129552:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922396544 00000100:00100000:2.0:1787782828.129607:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787782828.129617:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922396544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787782828.129655:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787782828.129705:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922396544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782828.129719:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1787782828.129781:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c313c94e940 x1874625922396544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782828.129815:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922396544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782828.132877:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31412130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922396672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782828.134583:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782828.134641:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922396672 00000100:00100000:3.0:1787782828.134650:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922396672 00000100:00100000:3.0:1787782828.136433:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787782828.136453:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922396672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782828.137216:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782828.138382:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922396672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1929us (5353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782828.138395:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787782828.140179:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31412130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922396672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787782828.385607:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782829.412441:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782829.580357:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782829.580456:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782829.587609:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782829.587677:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904533632 00000100:00100000:0.0:1787782829.587696:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904533632 00000100:00100000:0.0:1787782829.587752:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 283 00000100:00100000:0.0:1787782829.587763:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2350:x1874625904533632:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782829.587820:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782829.587840:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2350:x1874625904533632:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782829.587864:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 283 00000100:00100000:0.0:1787782829.587905:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904533888 00000100:00100000:0.0:1787782829.587909:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904533888 00000100:00100000:0.0:1787782829.587953:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:0.0:1787782829.587963:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31412121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2350:x1874625904533888:12345-192.168.202.15@tcp:400:kworker.0 00000100:00080000:1.0:1787782829.587993:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787782829.588003:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31412121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2350:x1874625904533888:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 42us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782829.588011:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:2.0:1787782829.591044:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904533760 00000100:00100000:2.0:1787782829.591058:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904533760 00000100:00100000:2.0:1787782829.591169:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904534016 00000100:00100000:2.0:1787782829.591172:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904534016 00000100:00100000:2.0:1787782829.591204:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:2.0:1787782829.591213:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31412130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2350:x1874625904533760:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782829.591311:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31412130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2350:x1874625904533760:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 98us (10964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782829.591320:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:0.0:1787782829.591331:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:0.0:1787782829.591344:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2350:x1874625904534016:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782829.591376:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2350:x1874625904534016:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 36us (10920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782829.591382:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00080000:1.0:1787782829.591453:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787782830.433499:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782831.457410:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782832.482132:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782832.737449:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922396928:0@lo:400:kworker.0 00000100:00100000:0.0:1787782832.737520:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782832.737622:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922396800:0@lo:400:kworker.0 00000100:00100000:1.0:1787782832.737651:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782832.737692:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922396800 00000100:00100000:1.0:1787782832.737698:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922396800 00000100:00100000:1.0:1787782832.737733:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787782832.737739:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922396800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782832.737777:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922396800:12345-0@lo:400:kworker.0 Request processed in 39us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782832.737782:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787782832.737816:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922396800:0@lo:400:kworker.0 00000100:00100000:3.0:1787782832.737917:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922396928 00000100:00100000:3.0:1787782832.737920:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922396928 00000100:00100000:3.0:1787782832.737959:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787782832.737967:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922396928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782832.738128:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874625922397056:0@lo:400:kworker.0 00000100:00100000:1.0:1787782832.738170:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782832.738199:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922397056 00000100:00100000:1.0:1787782832.738203:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922397056 00000100:00100000:1.0:1787782832.738234:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787782832.738241:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141212940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874625922397056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782832.738290:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141212940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874625922397056:12345-0@lo:400:kworker.0 Request processed in 49us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782832.738297:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1787782832.738314:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782832.738332:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874625922397056:0@lo:400:kworker.0 00000100:00100000:3.0:1787782832.738465:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922396928:12345-0@lo:400:kworker.0 Request processed in 499us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782832.738478:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787782832.742511:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922396928:0@lo:400:kworker.0 00000100:00100000:3.0:1787782832.743341:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787782832.743357:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922397440:0@lo:400:kworker.0 00000100:00100000:3.0:1787782832.743419:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782832.743495:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922397312:0@lo:400:kworker.0 00000100:00100000:1.0:1787782832.743526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782832.743552:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787782832.743556:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922397184:0@lo:400:kworker.0 00000100:00100000:1.0:1787782832.743575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782832.743662:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922397312 00000100:00100000:3.0:1787782832.743668:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922397312 00000100:00100000:3.0:1787782832.743729:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787782832.743737:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141213c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922397312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782832.743784:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141213c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922397312:12345-0@lo:400:kworker.0 Request processed in 47us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782832.743791:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1787782832.743846:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782832.743872:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922397312:0@lo:400:kworker.0 00000100:00100000:2.0:1787782832.743960:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922397440 00000100:00100000:2.0:1787782832.743964:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922397440 00000100:00100000:2.0:1787782832.744031:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922397184 00000100:00100000:2.0:1787782832.744034:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922397184 00000100:00100000:0.0:1787782832.744078:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787782832.744086:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922397440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782832.744150:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922397440:12345-0@lo:400:kworker.0 Request processed in 65us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782832.744156:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1787782832.745054:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c313c94cf00 x1874625922397440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782848 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782832.745070:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922397440:0@lo:400:kworker.0 00000100:00080000:1.0:1787782832.745200:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782832.745205:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787782832.746332:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787782832.746348:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141211680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922397184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782832.746436:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141211680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922397184:12345-0@lo:400:kworker.0 Request processed in 94us (2858us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782832.746444:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787782832.746517:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922397184:0@lo:400:kworker.0 00000100:00100000:2.0:1787782833.249618:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787782833.249644:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922397568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787782833.249722:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782833.249760:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922397568 00000100:00100000:0.0:1787782833.249782:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922397568 00000100:00100000:0.0:1787782833.249841:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787782833.249851:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922397568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787782833.249888:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782833.249947:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922397568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782833.249956:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1787782833.250088:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c313c94cf00 x1874625922397568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782833.250126:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922397568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782833.250766:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922397696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782833.250810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782833.252640:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922397696 00000100:00100000:1.0:1787782833.252654:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922397696 00000100:00100000:1.0:1787782833.252719:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787782833.252731:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922397696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782833.252766:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782833.252843:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922397696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782833.252864:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787782833.252964:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922397696:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787782833.506172:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787782834.467867:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787782834.529482:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782834.706472:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782834.706595:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782834.706634:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782834.706689:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782834.710350:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904534400 00000100:00100000:2.0:1787782834.710368:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904534400 00000100:00100000:2.0:1787782834.710459:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:2.0:1787782834.710470:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2349:x1874625904534400:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782834.710557:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2349:x1874625904534400:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 89us (3961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782834.710565:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00080000:1.0:1787782834.711708:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787782834.712301:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904534272 00000100:00100000:3.0:1787782834.712314:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904534272 00000100:00100000:3.0:1787782834.712430:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904534528 00000100:00100000:3.0:1787782834.712435:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904534528 00000100:00080000:1.0:1787782834.712437:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782834.719680:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904534144 00000100:00100000:0.0:1787782834.719697:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904534144 00000100:00100000:0.0:1787782834.719770:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 285 00000100:00100000:0.0:1787782834.719782:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2349:x1874625904534144:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782834.719872:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2349:x1874625904534144:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 93us (13411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782834.719881:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 285 00000100:00100000:1.0:1787782834.720527:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 125 00000100:00100000:1.0:1787782834.720542:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310826a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2349:x1874625904534272:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782834.720588:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 126 00000100:00100000:1.0:1787782834.720593:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310826a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2349:x1874625904534272:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 54us (13956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782834.720605:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 125 00000100:00100000:3.0:1787782834.720606:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904534528:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782834.720642:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904534528:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 43us (13952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782834.720650:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 126 00010000:00010000:2.0:1787782835.553766:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782836.577547:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782837.601623:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782837.858072:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922398208:0@lo:400:kworker.0 00000100:00100000:0.0:1787782837.858195:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782837.858286:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787782837.858294:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922397824:0@lo:400:kworker.0 00000100:00100000:0.0:1787782837.858325:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782837.858352:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922398336:0@lo:400:kworker.0 00000100:00100000:0.0:1787782837.858387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782837.858421:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922397824 00000100:00100000:0.0:1787782837.858428:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922397824 00000100:00100000:0.0:1787782837.858474:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787782837.858500:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3304:x1874625922397824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782837.858553:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3304:x1874625922397824:12345-0@lo:400:kworker.0 Request processed in 56us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782837.858561:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787782837.858612:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874625922398080:0@lo:400:kworker.0 00000100:00100000:0.0:1787782837.858637:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782837.858658:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787782837.858663:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922397952:0@lo:400:kworker.0 00000100:00100000:0.0:1787782837.858684:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782837.858698:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922398464:0@lo:400:kworker.0 00000100:00100000:0.0:1787782837.858718:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782837.858742:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922398336 00000100:00100000:0.0:1787782837.858745:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922398336 00000100:00100000:0.0:1787782837.858776:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922398080 00000100:00100000:0.0:1787782837.858778:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922398080 00000100:00100000:0.0:1787782837.858790:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922397952 00000100:00100000:0.0:1787782837.858792:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922397952 00000100:00100000:0.0:1787782837.858805:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787782837.858811:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922398336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782837.858845:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922398336:12345-0@lo:400:kworker.0 Request processed in 34us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782837.858851:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787782837.858863:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787782837.858869:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874625922398080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782837.858902:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874625922398080:12345-0@lo:400:kworker.0 Request processed in 33us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782837.858917:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787782837.858929:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787782837.858934:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922397952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782837.858961:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922397952:12345-0@lo:400:kworker.0 Request processed in 27us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782837.858966:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1787782837.859002:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922397952:0@lo:400:kworker.0 00000100:00100000:0.0:1787782837.859014:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874625922398080:0@lo:400:kworker.0 00000100:00100000:0.0:1787782837.859039:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922397824:0@lo:400:kworker.0 00000100:00100000:0.0:1787782837.859049:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922398336:0@lo:400:kworker.0 00000100:00100000:3.0:1787782837.859147:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922398208 00000100:00100000:3.0:1787782837.859152:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922398208 00000100:00100000:3.0:1787782837.859190:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922398464 00000100:00100000:3.0:1787782837.859193:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922398464 00000100:00100000:3.0:1787782837.859226:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787782837.859235:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922398208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782837.859279:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922398208:12345-0@lo:400:kworker.0 Request processed in 46us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782837.859285:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787782837.859298:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787782837.859305:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922398464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782837.859335:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922398464:12345-0@lo:400:kworker.0 Request processed in 31us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782837.859341:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787782837.859375:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922398208:0@lo:400:kworker.0 00000100:00080000:1.0:1787782837.859785:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787782837.859790:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782837.859793:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787782837.859874:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c313c94c3c0 x1874625922398464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782837.859885:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922398464:0@lo:400:kworker.0 00000100:00100000:3.0:1787782838.374432:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787782838.374458:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922398592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782838.374539:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782838.376058:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922398592 00000100:00100000:0.0:1787782838.376071:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922398592 00000100:00100000:0.0:1787782838.376170:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787782838.376181:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922398592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787782838.376228:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782838.376300:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922398592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782838.376307:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1787782838.376355:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c313c94f840 x1874625922398592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782838.376406:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922398592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782838.376639:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922398720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782838.376677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782838.377267:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922398720 00000100:00100000:1.0:1787782838.377274:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922398720 00000100:00100000:1.0:1787782838.377310:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787782838.377318:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922398720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782838.377341:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782838.378167:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922398720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 846us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782838.378176:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787782838.383294:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922398720:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787782838.627905:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782839.651245:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782839.822851:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782839.822898:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782839.823028:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904534656 00000100:00100000:0.0:1787782839.823045:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904534656 00000100:00100000:0.0:1787782839.823208:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 287 00000100:00100000:0.0:1787782839.823231:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2349:x1874625904534656:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782839.823354:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2349:x1874625904534656:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 134us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782839.823363:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 287 00000100:00100000:3.0:1787782839.824301:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904534784 00000100:00100000:3.0:1787782839.824333:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904534784 00000100:00080000:1.0:1787782839.824421:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782839.824450:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 130 00000100:00100000:3.0:1787782839.824468:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2349:x1874625904534784:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782839.824556:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2349:x1874625904534784:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 95us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782839.824565:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 130 00000100:00100000:2.0:1787782839.840269:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782839.840413:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782839.840888:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904534912 00000100:00100000:3.0:1787782839.840904:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904534912 00000100:00100000:3.0:1787782839.841002:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:3.0:1787782839.841013:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2348:x1874625904534912:12345-192.168.202.15@tcp:9:kworker.0 00000020:00000080:3.0:1787782839.841054:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b6371f1 00000100:00080000:3.0:1787782839.841066:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8c3133fc0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787782839.841158:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:2.0:1787782839.841402:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787782839.841434:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782839.841849:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+2:2348:x1874625904534912:12345-192.168.202.15@tcp:9:kworker.0 Request processed in 836us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782839.841975:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904535040 00000100:00100000:1.0:1787782839.841982:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904535040 00000100:00080000:1.0:1787782839.842009:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782839.842054:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 131 00000100:00100000:1.0:1787782839.842063:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904535040:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782839.842143:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904535040:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 81us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782839.842151:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 131 00000100:00100000:3.0:1787782839.842412:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00010000:00010000:2.0:1787782840.673652:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787782841.021770:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e4b0e72-6952-496d-b228-ab2778cd786f 00000020:00000080:1.0:1787782841.021782:0:6723:0:(genops.c:885:class_export_put()) final put ffff8c3133fc2000/6e4b0e72-6952-496d-b228-ab2778cd786f 00000020:00000080:3.0:1787782841.021940:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3133fc2000/6e4b0e72-6952-496d-b228-ab2778cd786f for lustre-OST0000 00000020:00000080:3.0:1787782841.022013:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3133fc0800 for lustre-OST0000 00010000:00010000:1.0:1787782841.700810:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782842.731831:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782842.983647:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922398976:0@lo:400:kworker.0 00000100:00100000:1.0:1787782842.983756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782842.983832:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922399488:0@lo:400:kworker.0 00000100:00100000:1.0:1787782842.983864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782842.983904:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782842.983910:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922399104:0@lo:400:kworker.0 00000100:00100000:1.0:1787782842.983937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782842.983981:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922398976 00000100:00100000:1.0:1787782842.983989:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922398976 00000100:00100000:1.0:1787782842.984045:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922399104 00000100:00100000:1.0:1787782842.984049:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922399104 00000100:00100000:1.0:1787782842.984086:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787782842.984346:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922398848:0@lo:400:kworker.0 00000100:00100000:2.0:1787782842.984393:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782842.984496:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922399360:0@lo:400:kworker.0 00000100:00100000:2.0:1787782842.984524:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782842.984540:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787782842.984545:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922399232:0@lo:400:kworker.0 00000100:00100000:2.0:1787782842.984594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782842.984768:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922399360 00000100:00100000:2.0:1787782842.984773:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922399360 00000100:00100000:2.0:1787782842.984802:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787782842.984808:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922399104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782842.984882:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922399104:12345-0@lo:400:kworker.0 Request processed in 73us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782842.984889:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787782842.984908:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787782842.984914:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922399360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782842.984942:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922399360:12345-0@lo:400:kworker.0 Request processed in 29us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782842.984963:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787782842.984987:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922399488 00000100:00100000:2.0:1787782842.984990:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922399488 00000100:00100000:2.0:1787782842.985018:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922399232 00000100:00100000:2.0:1787782842.985022:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922399232 00000100:00100000:2.0:1787782842.985043:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787782842.985049:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922399488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782842.985082:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922399488:12345-0@lo:400:kworker.0 Request processed in 33us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782842.985087:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787782842.985550:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922398848 00000100:00100000:0.0:1787782842.985558:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922398848 00000100:00100000:0.0:1787782842.985594:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787782842.985602:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922398848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782842.985644:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922398848:12345-0@lo:400:kworker.0 Request processed in 44us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782842.985651:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787782842.985689:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787782842.985697:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110740b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922399232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782842.985728:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110740b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922399232:12345-0@lo:400:kworker.0 Request processed in 33us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782842.985734:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787782842.986879:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922399232:0@lo:400:kworker.0 00000100:00100000:2.0:1787782842.986900:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922398848:0@lo:400:kworker.0 00000100:00100000:2.0:1787782842.986911:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922399360:0@lo:400:kworker.0 00000100:00080000:2.0:1787782842.986985:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787782842.986991:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787782842.986995:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782842.987171:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922398976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782842.988385:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922398976:12345-0@lo:400:kworker.0 Request processed in 4284us (4623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782842.988400:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787782842.988620:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922399104:0@lo:400:kworker.0 00000100:00100000:1.0:1787782842.988637:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922398976:0@lo:400:kworker.0 00010000:00080000:1.0:1787782842.988655:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31344ee1c0 x1874625922399488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782842.988668:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344ee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922399488:0@lo:400:kworker.0 00000100:00100000:1.0:1787782843.490705:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31342fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922399616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782843.490803:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782843.490907:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922399616 00000100:00100000:1.0:1787782843.490917:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922399616 00000100:00100000:1.0:1787782843.490977:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787782843.490987:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922399616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787782843.491038:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782843.491123:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ed680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922399616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782843.491132:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1787782843.491405:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31342fd680 x1874625922399616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782843.491427:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31342fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922399616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782843.492642:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787782843.492664:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922399744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782843.492731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782843.492794:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922399744 00000100:00100000:1.0:1787782843.492802:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922399744 00000100:00100000:1.0:1787782843.492850:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787782843.492859:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922399744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782843.492903:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782843.492951:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922399744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782843.492959:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787782843.493028:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922399744:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787782843.745362:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787782844.709391:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787782844.773456:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782844.950515:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782844.950577:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782844.950638:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782844.950672:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904535424 00000100:00100000:2.0:1787782844.950686:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904535424 00000100:00100000:2.0:1787782844.950758:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904535296 00000100:00100000:2.0:1787782844.950762:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904535296 00000100:00100000:2.0:1787782844.950791:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 135 00000100:00100000:2.0:1787782844.950803:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110740780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2352:x1874625904535424:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782844.950898:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110740780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2352:x1874625904535424:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 97us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782844.950907:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 135 00000100:00100000:2.0:1787782844.950929:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 136 00000100:00100000:2.0:1787782844.950935:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110742580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2352:x1874625904535296:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782844.951048:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904535168 00000100:00100000:1.0:1787782844.951054:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904535168 00000100:00100000:1.0:1787782844.951090:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 289 00000100:00100000:1.0:1787782844.951131:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2352:x1874625904535168:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782844.951177:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2352:x1874625904535168:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 48us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782844.951184:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 289 00000100:00100000:2.0:1787782844.951301:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110742580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2352:x1874625904535296:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 365us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782844.951309:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 136 00000100:00080000:2.0:1787782844.951333:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787782845.794738:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787782846.597059:0:11858:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 18:20:44 (1787782844) 00010000:00010000:2.0:1787782846.818500:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782847.845539:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782848.099535:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922399872:0@lo:400:kworker.0 00000100:00100000:1.0:1787782848.099647:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782848.099717:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922400384:0@lo:400:kworker.0 00000100:00100000:1.0:1787782848.099747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782848.099777:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787782848.099783:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922400256:0@lo:400:kworker.0 00000100:00100000:1.0:1787782848.099811:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782848.099845:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922400000:0@lo:400:kworker.0 00000100:00100000:1.0:1787782848.099871:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782848.099888:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922400512:0@lo:400:kworker.0 00000100:00100000:1.0:1787782848.099911:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782848.099929:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782848.099954:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922400128:0@lo:400:kworker.0 00000100:00100000:1.0:1787782848.099981:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782848.100657:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922400384 00000100:00100000:2.0:1787782848.100669:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922400384 00000100:00100000:2.0:1787782848.100750:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922400000 00000100:00100000:2.0:1787782848.100754:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922400000 00000100:00100000:2.0:1787782848.100768:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922400128 00000100:00100000:2.0:1787782848.100770:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922400128 00000100:00100000:2.0:1787782848.100788:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787782848.100800:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922400384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782848.100888:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922400384:12345-0@lo:400:kworker.0 Request processed in 89us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782848.100909:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787782848.100930:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787782848.100936:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922400000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782848.100973:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922400000:12345-0@lo:400:kworker.0 Request processed in 37us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782848.100979:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787782848.100991:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787782848.100997:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922400128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782848.101024:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922400128:12345-0@lo:400:kworker.0 Request processed in 28us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782848.101030:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787782848.101401:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922400384:0@lo:400:kworker.0 00000100:00080000:1.0:1787782848.102422:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782848.102468:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922400128:0@lo:400:kworker.0 00000100:00100000:1.0:1787782848.102482:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922400000:0@lo:400:kworker.0 00000100:00100000:0.0:1787782848.102610:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922399872 00000100:00100000:0.0:1787782848.102628:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922399872 00000100:00100000:0.0:1787782848.102683:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787782848.102691:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922399872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782848.102774:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922399872:12345-0@lo:400:kworker.0 Request processed in 84us (3129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782848.102782:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787782848.102827:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922400256 00000100:00100000:0.0:1787782848.102830:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922400256 00000100:00100000:0.0:1787782848.102864:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922400512 00000100:00100000:0.0:1787782848.102867:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922400512 00000100:00100000:0.0:1787782848.102890:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787782848.102896:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922400256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782848.102933:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922400256:12345-0@lo:400:kworker.0 Request processed in 38us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782848.102940:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787782848.102952:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787782848.102957:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922400512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782848.102990:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922400512:12345-0@lo:400:kworker.0 Request processed in 33us (3078us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782848.102996:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1787782848.103028:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787782848.103031:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787782848.103058:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31344ee580 x1874625922400512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787782864 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782848.103091:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922400512:0@lo:400:kworker.0 00000100:00100000:2.0:1787782848.104842:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922400256:0@lo:400:kworker.0 00000100:00100000:2.0:1787782848.104864:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922399872:0@lo:400:kworker.0 00000100:00100000:0.0:1787782848.609807:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787782848.609850:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31342ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922400640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782848.609979:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782848.610695:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922400640 00000100:00100000:1.0:1787782848.610706:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922400640 00000100:00100000:1.0:1787782848.610783:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787782848.610796:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922400640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787782848.610849:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782848.610930:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922400640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782848.610938:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1787782848.611000:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31342ffc00 x1874625922400640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787782864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782848.611037:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31342ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922400640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787782848.611595:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787782848.611616:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31107412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922400768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787782848.612047:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782848.612155:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922400768 00000100:00100000:3.0:1787782848.612163:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922400768 00000100:00100000:3.0:1787782848.612217:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787782848.612226:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110741680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922400768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782848.612263:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782848.612317:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110741680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922400768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782848.612324:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787782848.612403:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31107412c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922400768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782848.722747:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782848.722961:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904535552 00000100:00100000:0.0:1787782848.722985:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904535552 00000100:00100000:0.0:1787782848.723269:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:0.0:1787782848.723283:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:10236:x1874625904535552:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787782848.723317:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782848.723354:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b6372bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e52e5 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782848.723450:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b6372c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782848.723469:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b6372c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782848.723486:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b6372c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782848.724397:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787782848.724408:0:6719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787782848.724545:0:6719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b6372c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782848.724691:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b6372bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52e5 expref: 7 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782848.724730:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b6372c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52e5 expref: 6 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782848.724742:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c310823c700) 00010000:00010000:0.0:1787782848.724747:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787782848.724752:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254000, rc 0) 00000100:00100000:0.0:1787782848.724922:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:10236:x1874625904535552:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 1641us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782848.724932:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00080000:1.0:1787782848.727284:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782848.740832:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782848.742009:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904535680 00000100:00100000:3.0:1787782848.742027:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904535680 00000100:00100000:3.0:1787782848.742423:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:3.0:1787782848.742435:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31107412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:10237:x1874625904535680:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787782848.742464:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782848.742493:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6372ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e52ec expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.743002:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6372d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.743023:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6372d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.743046:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6372d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.743367:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6372d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.743377:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6372d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.743385:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6372d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744214:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0e00/0x6d98ed19b6372df lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744229:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0e00/0x6d98ed19b6372df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744247:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0e00/0x6d98ed19b6372df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782848.744357:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787782848.744363:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787782848.744455:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0e00/0x6d98ed19b6372df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744470:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6372d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744478:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6372d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744486:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6372d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744493:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782848.744498:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6372d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744507:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6372d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744522:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c310823c700) 00010000:00010000:3.0:1787782848.744526:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782848.744531:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6372d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744538:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6372d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744565:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6372d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744571:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6372d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744577:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6372d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744582:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782848.744585:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6372d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744592:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6372d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744600:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8c3104d6ec00) 00010000:00010000:3.0:1787782848.744602:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782848.744605:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6372d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744610:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6372d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744657:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6372ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52ec expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744674:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0e00/0x6d98ed19b6372df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52ec expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782848.744694:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c3104d6ef00) 00010000:00010000:3.0:1787782848.744696:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787782848.744699:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0e00, rc 0) 00000100:00100000:3.0:1787782848.744807:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31107412c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:10237:x1874625904535680:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 2372us (3992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782848.744816:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:2.0:1787782848.750615:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782848.750893:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904535936 00000100:00100000:0.0:1787782848.750908:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904535936 00000100:00100000:0.0:1787782848.750991:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:0.0:1787782848.751004:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110743c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+7:10237:x1874625904535936:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787782848.751036:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782848.751083:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b6372e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e52f3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782848.751242:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6372ed lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782848.751261:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6372ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782848.751276:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6372ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.753291:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6372f4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.753324:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6372f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.753340:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6372f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.755453:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6800/0x6d98ed19b6372fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.755491:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6800/0x6d98ed19b6372fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.755506:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6800/0x6d98ed19b6372fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782848.755524:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787782848.755819:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6372ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.755829:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6372ed lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.755838:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6372ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.755845:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782848.755851:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6372ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.755862:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6372ed lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.755879:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c3104d6ef00) 00010000:00010000:1.0:1787782848.755883:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782848.755889:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6372ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.755897:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6372ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.755915:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6372f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.755928:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6372f4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.755934:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6372f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.755939:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782848.755943:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6372f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.755949:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6372f4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.755958:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c312eeef000) 00010000:00010000:1.0:1787782848.755960:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782848.755963:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6372f4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.755969:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6372f4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.758388:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b6372e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52f3 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.758421:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6800/0x6d98ed19b6372fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52f3 expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782848.758432:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c312eeef700) 00010000:00010000:1.0:1787782848.758435:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782848.758448:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6800, rc 0) 00000100:00100000:1.0:1787782848.758554:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110743c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+9:10237:x1874625904535936:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 7551us (7955us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787782848.758566:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:2.0:1787782848.782064:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782848.791178:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904536064 00000100:00100000:0.0:1787782848.791232:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904536064 00000100:00100000:3.0:1787782848.796027:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:3.0:1787782848.796064:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110743840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+9:10237:x1874625904536064:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787782848.796267:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110743840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+9:10237:x1874625904536064:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 Request processed in 216us (14231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782848.796277:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00000040:00080000:0.0:1787782848.802387:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787782848.865468:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782849.889302:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782850.065585:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782850.065657:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782850.065694:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782850.065738:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904536448 00000100:00100000:3.0:1787782850.065751:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904536448 00000100:00100000:3.0:1787782850.065826:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904536320 00000100:00100000:3.0:1787782850.065830:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904536320 00000100:00100000:3.0:1787782850.065861:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 140 00000100:00100000:3.0:1787782850.065873:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2350:x1874625904536448:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782850.066135:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2350:x1874625904536448:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 222us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782850.066146:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 140 00000100:00100000:3.0:1787782850.066169:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 141 00000100:00100000:3.0:1787782850.066194:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2350:x1874625904536320:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782850.066225:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2350:x1874625904536320:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 32us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782850.066232:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 141 00000100:00080000:3.0:1787782850.066254:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782850.066468:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904536192 00000100:00100000:0.0:1787782850.066474:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904536192 00000100:00100000:0.0:1787782850.066520:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 291 00000100:00100000:0.0:1787782850.066528:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2350:x1874625904536192:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782850.066564:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109170850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2350:x1874625904536192:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 38us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782850.066572:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 291 00010000:00010000:0.0:1787782850.914066:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787782851.247500:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:3.0:1787782851.495429:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782851.495573:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904536576 00000100:00100000:2.0:1787782851.495610:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904536576 00000100:00100000:2.0:1787782851.495681:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:2.0:1787782851.495695:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+8:10280:x1874625904536576:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787782851.495724:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782851.495755:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b637309 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e52fa expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.495848:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637310 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.495868:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637310 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.495886:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637310 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.495905:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637317 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.495913:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.495920:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496338:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637310 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496348:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637310 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496357:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637310 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496372:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f294000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782851.496377:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637310 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496386:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637310 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496404:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c310823c700) 00010000:00010000:2.0:1787782851.496407:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782851.496414:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637310 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496421:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637310 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496435:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496442:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637317 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496448:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637317 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496453:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f294400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782851.496456:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637317 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496462:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637317 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496481:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c3108738700) 00010000:00010000:2.0:1787782851.496484:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782851.496487:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637317 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496494:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637317 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496539:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b637309 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52fa expref: 9 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496551:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c310823c700) 00010000:00010000:2.0:1787782851.496554:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782851.496557:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b637309 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52fa expref: 9 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.496567:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312f295c00, rc 0) 00000100:00100000:2.0:1787782851.496649:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+8:10280:x1874625904536576:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 956us (1240us total) trans 0 rc 301/301 00000100:00100000:2.0:1787782851.496658:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:0.0:1787782851.502197:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782851.502409:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904536832 00000100:00100000:2.0:1787782851.502423:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904536832 00000100:00100000:2.0:1787782851.502504:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:2.0:1787782851.502518:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+8:10280:x1874625904536832:12345-192.168.202.15@tcp:36:lfs.0 00010000:00010000:2.0:1787782851.502595:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782851.502635:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b6372c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52e5 expref: 8 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.502672:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c310823c700) 00010000:00010000:2.0:1787782851.502687:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782851.503070:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295a00/0x6d98ed19b63731e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.503131:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295a00/0x6d98ed19b63731e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.503145:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295a00/0x6d98ed19b63731e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.503161:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b637325 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.503170:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b637325 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.503177:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b637325 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782851.504385:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787782851.504404:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295a00/0x6d98ed19b63731e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.504416:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295a00/0x6d98ed19b63731e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.504424:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295a00/0x6d98ed19b63731e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.504431:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f295a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782851.504447:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295a00/0x6d98ed19b63731e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.504457:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295a00/0x6d98ed19b63731e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.504473:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3108738500) 00010000:00010000:2.0:1787782851.504476:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782851.504482:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295a00/0x6d98ed19b63731e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.504489:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295a00/0x6d98ed19b63731e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787782851.504512:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000913e493c reply state 00000000bc5d3e37 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b637325 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782851.504523:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787782851.504680:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+9:10280:x1874625904536832:12345-192.168.202.15@tcp:36:lfs.0 Request processed in 2161us (2496us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787782851.504691:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00010000:00010000:2.0:1787782851.519217:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b637325 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.519242:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b637325 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.519251:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b637325 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.519259:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f294200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782851.519265:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b637325 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.519296:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b637325 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.519318:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c3108738800) 00010000:00010000:2.0:1787782851.519321:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782851.519328:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b637325 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.519336:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b637325 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782851.665027:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782851.665074:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904536960 00000100:00100000:2.0:1787782851.665109:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904536960 00000100:00100000:2.0:1787782851.665182:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:2.0:1787782851.665194:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110742940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+8:10288:x1874625904536960:12345-192.168.202.15@tcp:101:lctl.0 00010000:00010000:2.0:1787782851.665229:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782851.665260:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b63732c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5301 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.665380:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295a00/0x6d98ed19b637333 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.665397:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295a00/0x6d98ed19b637333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.665412:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295a00/0x6d98ed19b637333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782851.665497:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787782851.665508:0:6719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782851.665567:0:6719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295a00/0x6d98ed19b637333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.665598:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b63732c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5301 expref: 10 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.665632:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295a00/0x6d98ed19b637333 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5301 expref: 9 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.665642:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3108738800) 00010000:00010000:2.0:1787782851.665645:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787782851.665649:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312f295a00, rc 0) 00000100:00100000:2.0:1787782851.665725:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110742940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+9:10288:x1874625904536960:12345-192.168.202.15@tcp:101:lctl.0 Request processed in 532us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782851.665733:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:0.0:1787782851.748948:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782851.749046:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904537088 00000100:00100000:2.0:1787782851.749060:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904537088 00000100:00100000:2.0:1787782851.749190:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:2.0:1787782851.749201:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eedb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+9:10294:x1874625904537088:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787782851.749229:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782851.749257:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b63733a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5308 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.749340:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637341 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.749357:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637341 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.749396:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637341 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.749414:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637348 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.749422:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637348 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.749429:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637348 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.749575:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295e00/0x6d98ed19b63734f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.749583:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295e00/0x6d98ed19b63734f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.749590:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295e00/0x6d98ed19b63734f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782851.750339:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787782851.750346:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787782851.750409:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295e00/0x6d98ed19b63734f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750426:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637341 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750434:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637341 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750443:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637341 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750450:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f294400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782851.750455:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637341 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750466:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637341 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750482:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3108738800) 00010000:00010000:3.0:1787782851.750486:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782851.750492:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637341 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750516:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637341 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750534:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637348 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750540:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637348 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750546:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637348 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750551:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f294000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782851.750554:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637348 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750559:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637348 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750566:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c3108738500) 00010000:00010000:3.0:1787782851.750569:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782851.750572:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637348 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750579:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637348 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750715:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b63733a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5308 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750732:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295e00/0x6d98ed19b63734f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5308 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782851.750746:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:3.0:1787782851.750748:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787782851.750751:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312f295e00, rc 0) 00000100:00100000:3.0:1787782851.750862:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eedb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+10:10294:x1874625904537088:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1662us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782851.750872:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:2.0:1787782851.755705:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782851.756070:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904537344 00000100:00100000:0.0:1787782851.756092:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904537344 00000100:00100000:1.0:1787782851.756562:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:1.0:1787782851.756576:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31107421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+10:10294:x1874625904537344:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787782851.756628:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782851.756659:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637356 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e530f expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.756832:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b63735d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.756850:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b63735d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.756864:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b63735d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.757073:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637364 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.757150:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.757163:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787782851.757829:0:6719:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1787782851.758047:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63736b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.758059:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63736b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.758069:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63736b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.758145:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b63735d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.758153:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b63735d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.758160:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b63735d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.758166:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782851.758170:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b63735d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.758177:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b63735d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.758191:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:1.0:1787782851.758194:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782851.758198:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b63735d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.758204:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b63735d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787782851.758227:0:6719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063854f1f reply state 0000000022f1dc07 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782851.758236:0:6719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787782851.758274:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637356 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e530f expref: 13 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.758288:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63736b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e530f expref: 12 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.758295:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef300) 00010000:00010000:1.0:1787782851.758298:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782851.758300:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6400, rc 0) 00000100:00100000:1.0:1787782851.758385:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31107421c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+13:10294:x1874625904537344:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1811us (2696us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787782851.758394:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 40 00010000:00010000:1.0:1787782851.764686:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.764708:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637364 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.764717:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.764726:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782851.764732:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.764765:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637364 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.764785:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c312eeef000) 00010000:00010000:1.0:1787782851.764788:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782851.764793:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637364 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782851.764799:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637364 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782851.765008:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782851.765143:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904537472 00000100:00100000:0.0:1787782851.765157:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904537472 00000100:00100000:0.0:1787782851.765215:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:0.0:1787782851.765226:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110741a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1874625904537472:12345-192.168.202.15@tcp:8:bash.0 00010000:00080000:0.0:1787782851.765271:0:6967:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:0.0:1787782851.765316:0:6967:0:(genops.c:1385:class_connect()) connect: client 6e4b0e72-6952-496d-b228-ab2778cd786f, cookie 0x6d98ed19b637379 00002000:00100000:0.0:1787782851.765333:0:6967:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e4b0e72-6952-496d-b228-ab2778cd786f/ffff8c3107f9f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113937 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787782851.765368:0:6967:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787782851.765840:0:6967:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787782851.765884:0:6967:0:(import.c:65:import_set_state_nolock()) ffff8c3107f9d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787782851.765979:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110741a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2348:x1874625904537472:12345-192.168.202.15@tcp:8:bash.0 Request processed in 752us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782851.766006:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:3.0:1787782851.768788:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782851.768890:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904537600 00000100:00100000:0.0:1787782851.768902:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904537600 00000100:00100000:0.0:1787782851.768999:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:0.0:1787782851.769012:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:0:x1874625904537600:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787782851.769039:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782851.769072:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043d62bb5/0x6d98ed19b637380 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5316 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787782851.769144:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782851.769171:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:0.0:1787782851.769176:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782851.769189:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043d62bb5/0x6d98ed19b637380 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5316 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.769214:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043d62bb5/0x6d98ed19b637380 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5316 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.769232:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255000, rc 0) 00000100:00100000:0.0:1787782851.769312:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:0:x1874625904537600:12345-192.168.202.15@tcp:101:bash.0 Request processed in 303us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782851.769320:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00080000:3.0:1787782851.769483:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787782851.775769:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782851.776160:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904537728 00000100:00100000:0.0:1787782851.776173:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904537728 00000100:00100000:0.0:1787782851.776243:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:0.0:1787782851.776256:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+7:10294:x1874625904537728:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787782851.776301:0:6967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782851.776326:0:6967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e531d expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.776367:0:6967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043d62bb5/0x6d98ed19b637380 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5316 expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.776378:0:6967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782851.776383:0:6967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782851.776389:0:6967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e531d expref: 8 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.776433:0:6967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043d62bb5/0x6d98ed19b637380 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5316 expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.776451:0:6967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043d62bb5/0x6d98ed19b637380 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5316 expref: 8 pid: 6698 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782851.776469:0:6967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6967:1874625922400896:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787782851.777642:0:6967:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3108f070c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782851.780734:0:6967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6967:1874625922400896:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787782851.780785:0:6967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e531d expref: 8 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.780811:0:6967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254600, rc 0) 00000100:00100000:0.0:1787782851.780921:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+8:10294:x1874625904537728:12345-192.168.202.15@tcp:101:bash.0 Request processed in 4668us (5169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782851.780932:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:3.0:1787782851.782354:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782851.782462:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904537856 00000100:00100000:0.0:1787782851.782473:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904537856 00010000:00010000:0.0:1787782851.782524:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043d62bb5/0x6d98ed19b637380 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5316 expref: 8 pid: 6698 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782851.782586:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:0.0:1787782851.782596:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2350:x1874625904537856:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782851.782750:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782851.782783:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043d62bb5/0x6d98ed19b637380 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5316 expref: 8 pid: 6698 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.782799:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043d62bb5/0x6d98ed19b637380 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5316 expref: 8 pid: 6698 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.782829:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043d62bb5/0x6d98ed19b637380 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5316 expref: 8 pid: 6698 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.782849:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782851.782854:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782851.782864:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e531d expref: 7 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.782874:0:7637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e531d expref: 7 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.782940:0:7637:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e531d expref: 7 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782851.782960:0:7637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d6580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7637:1874625922401024:192.168.202.15@tcp:105: 00000100:00100000:0.0:1787782851.783062:0:7637:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3108f070c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782851.786765:0:7637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d6580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7637:1874625922401024:192.168.202.15@tcp:105: 00010000:00010000:0.0:1787782851.786803:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782851.786874:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2350:x1874625904537856:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 4278us (4526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782851.786887:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:1.0:1787782851.788514:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782851.788667:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904538112 00000100:00100000:2.0:1787782851.788681:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904538112 00000100:00100000:2.0:1787782851.788755:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:2.0:1787782851.788766:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+12:10294:x1874625904538112:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:2.0:1787782851.789286:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+13:10294:x1874625904538112:12345-192.168.202.15@tcp:35:bash.0 Request processed in 521us (782us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787782851.789315:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:3.0:1787782851.881439:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782851.882411:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904538368 00000100:00100000:0.0:1787782851.882425:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904538368 00000100:00100000:0.0:1787782851.882630:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:0.0:1787782851.882644:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+13:10304:x1874625904538368:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787782851.882681:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782851.882711:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b63738e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5324 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782851.882896:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787782851.884420:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b63738e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5324 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.884451:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3108738800) 00010000:00010000:0.0:1787782851.884455:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787782851.884485:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b63738e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5324 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.884511:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255000, rc 0) 00000100:00100000:0.0:1787782851.884815:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+14:10304:x1874625904538368:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 2172us (3391us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1787782851.884826:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:3.0:1787782851.888485:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782851.888586:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904538624 00000100:00100000:0.0:1787782851.888611:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904538624 00000100:00100000:0.0:1787782851.888690:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:0.0:1787782851.888703:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+14:10304:x1874625904538624:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787782851.889160:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+15:10304:x1874625904538624:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 456us (687us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787782851.889170:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00010000:00010000:0.0:1787782851.937556:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782851.967940:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782851.968134:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904538752 00000100:00100000:2.0:1787782851.968147:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904538752 00000100:00100000:2.0:1787782851.968235:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:2.0:1787782851.968249:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+15:10310:x1874625904538752:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787782851.968283:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782851.968314:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b63739c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e532b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.968419:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294800/0x6d98ed19b6373a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.968439:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294800/0x6d98ed19b6373a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.968454:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294800/0x6d98ed19b6373a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782851.968562:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787782851.968567:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782851.968598:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294800/0x6d98ed19b6373a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.968633:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b63739c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e532b expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.968658:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294800/0x6d98ed19b6373a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e532b expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.968697:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:2.0:1787782851.968701:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787782851.968706:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312f294800, rc 0) 00000100:00100000:2.0:1787782851.968799:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+16:10310:x1874625904538752:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 553us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782851.968808:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:3.0:1787782851.975474:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782851.976493:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904539008 00000100:00100000:0.0:1787782851.976509:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904539008 00000100:00100000:0.0:1787782851.976766:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:0.0:1787782851.976778:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+16:10310:x1874625904539008:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787782851.976808:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782851.976838:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6373aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5332 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.976989:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b6373b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.977016:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b6373b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.977055:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b6373b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782851.977069:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787782851.977430:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6373aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5332 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.977453:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b6373b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5332 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.977463:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef300) 00010000:00010000:0.0:1787782851.977466:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787782851.977471:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254e00, rc 0) 00000100:00100000:0.0:1787782851.977784:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+18:10310:x1874625904539008:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1006us (2358us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787782851.977794:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:3.0:1787782851.980574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782851.980752:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782851.981207:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904539392 00000100:00100000:0.0:1787782851.981220:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904539392 00000100:00100000:0.0:1787782851.981301:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:0.0:1787782851.981314:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+18:10310:x1874625904539392:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787782851.981345:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782851.981372:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b6373bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5339 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.981502:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6373c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.981729:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6373c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.981744:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6373c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782851.981762:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787782851.981957:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b6373bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5339 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.981978:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6373c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5339 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.981988:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef300) 00010000:00010000:0.0:1787782851.981991:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787782851.981995:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255800, rc 0) 00000100:00100000:0.0:1787782851.982135:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+20:10310:x1874625904539392:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 823us (1382us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787782851.982144:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:2.0:1787782851.987360:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904539136 00000100:00100000:2.0:1787782851.987384:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904539136 00000100:00100000:2.0:1787782851.987560:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:2.0:1787782851.987574:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+20:2351:x1874625904539136:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782851.987607:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782851.987644:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b6373b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5332 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782851.987671:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef300) 00010000:00010000:2.0:1787782851.987677:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782851.987773:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+19:2351:x1874625904539136:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 203us (7216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782851.987782:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:3.0:1787782851.990459:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782851.990555:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904539520 00000100:00100000:0.0:1787782851.990567:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904539520 00000100:00100000:0.0:1787782851.990652:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:0.0:1787782851.990664:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2349:x1874625904539520:12345-192.168.202.15@tcp:1:lfs.0 00010000:00010000:0.0:1787782851.990721:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b6373d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.990748:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e531d expref: 7 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.990775:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782851.990779:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787782851.990784:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b6373d4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.990828:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e531d expref: 7 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782851.990844:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e531d expref: 7 pid: 6967 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782851.990862:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874625922401152:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787782851.990987:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3108f07780 going to sleep for 11 seconds 00000100:00100000:0.0:1787782851.994054:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874625922401152:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787782851.994138:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b6373d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782851.999452:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782852.000120:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904539648 00000100:00100000:1.0:1787782852.000132:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904539648 00002000:00100000:1.0:1787782852.000506:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8c3119e89e00 x1874625904539648/t0(0) o4->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:242/0 lens 504/0 e 0 to 0 dl 1787782862 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787782852.000517:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c3119e89e00 with x1874625904539648 ext(0->12) 00010000:00010000:1.0:1787782852.000525:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e531d expref: 8 pid: 6967 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.000543:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e531d expref: 8 pid: 6967 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787782852.000550:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c3119e89e00 00000100:00100000:1.0:1787782852.000802:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:1.0:1787782852.000813:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2350:x1874625904539648:12345-192.168.202.15@tcp:4:lfs.0 00000001:00100000:2.0:1787782852.047402:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e4b0e72-6952-496d-b228-ab2778cd786f 00000100:00100000:2.0:1787782852.049560:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2350:x1874625904539648:12345-192.168.202.15@tcp:4:lfs.0 Request processed in 48740us (50111us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787782852.049581:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00002000:00100000:2.0:1787782852.049596:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8c3119e89e00 x1874625904539648/t4294967299(0) o4->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:242/0 lens 504/448 e 0 to 0 dl 1787782862 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787782852.049625:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c3119e89e00 with x1874625904539648 ext(0->12) 00010000:00010000:2.0:1787782852.049636:0:6702:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e531d expref: 9 pid: 6967 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.049654:0:6702:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e531d expref: 9 pid: 6967 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787782852.049663:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c3119e89e00 00000100:00100000:3.0:1787782852.055713:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782852.055825:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904539776 00000100:00100000:2.0:1787782852.055835:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904539776 00010000:00010000:2.0:1787782852.055877:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e531d expref: 9 pid: 6967 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782852.055924:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:2.0:1787782852.055935:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2349:x1874625904539776:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782852.055954:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787782852.055974:0:5835:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787782852.055978:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787782851 00002000:00010000:2.0:1787782852.055980:0:5835:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787782852 00002000:00010000:2.0:1787782852.055982:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787782851 00010000:00010000:2.0:1787782852.055989:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e531d expref: 9 pid: 6967 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.056003:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e531d expref: 9 pid: 6967 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.056059:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637387 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e531d expref: 9 pid: 6967 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.056090:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787782852.056141:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787782852.056148:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b6373d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.056160:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b6373d4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.056199:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782852.056249:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2349:x1874625904539776:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 315us (546us total) trans 0 rc 0/0 00010000:00010000:3.0:1787782852.056465:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b6373d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.056476:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b6373d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.056504:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b6373d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.056521:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b6373d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.056529:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b6373d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.056537:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255c00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787782852.056542:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b6373d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.056552:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b6373d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.056566:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b6373d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.056573:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b6373d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782852.056624:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2349:x1874625904539520:12345-192.168.202.15@tcp:1:lfs.0 Request processed in 65962us (66178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782852.056634:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:2.0:1787782852.057198:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:0.0:1787782852.058628:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782852.058707:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904540032 00000100:00100000:2.0:1787782852.058716:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904540032 00000100:00100000:2.0:1787782852.058781:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:2.0:1787782852.058792:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+19:10310:x1874625904540032:12345-192.168.202.15@tcp:35:lfs.0 00000004:00010000:2.0:1787782852.058852:0:11490:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6373c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5339 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787782852.059215:0:11490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000100:00080000:3.0:1787782852.059397:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1787782852.059701:0:11490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787782852.060689:0:11490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1787782852.060764:0:11490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6373db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.060792:0:11490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63736b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e530f expref: 23 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.060801:0:11490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6373db lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.060840:0:11490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63736b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e530f expref: 23 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.060856:0:11490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63736b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e530f expref: 23 pid: 6719 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782852.060872:0:11490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3110740f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11490:1874625922401280:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787782852.061197:0:11490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312f10bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787782852.068524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782852.068680:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904540160 00000100:00100000:1.0:1787782852.068690:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904540160 00010000:00010000:1.0:1787782852.068733:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63736b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e530f expref: 24 pid: 6719 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782852.068783:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:1.0:1787782852.068795:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+24:2349:x1874625904540160:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782852.068811:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782852.068818:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63736b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e530f expref: 24 pid: 6719 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.068833:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63736b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e530f expref: 24 pid: 6719 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.068855:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef300) 00010000:00010000:1.0:1787782852.068862:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6373db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.068872:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6373db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.068881:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6373db lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.068902:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782852.068971:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+24:2349:x1874625904540160:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 177us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782852.068979:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00010000:00010000:2.0:1787782852.069788:0:11490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63736b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e530f expref: 23 pid: 6719 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782852.069807:0:11490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3110740f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11490:1874625922401280:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787782852.069830:0:11490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6373db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.069840:0:11490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6373db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.069845:0:11490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6373db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787782852.069990:0:11490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787782852.070476:0:11490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787782852.070615:0:11490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3110740f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11490:1874625922401408:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787782852.070719:0:11490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782852.070763:0:11490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312f10b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787782852.070917:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922401408 00000100:00100000:0.0:1787782852.070926:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922401408 00000100:00100000:0.0:1787782852.070997:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787782852.071016:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110741e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11490:x1874625922401408:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787782852.071127:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110741e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11490:x1874625922401408:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 121us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782852.071145:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787782852.071211:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787782852.071595:0:11490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3110740f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11490:1874625922401408:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:2.0:1787782852.076178:0:11490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787782852.076349:0:11490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3110740f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11490:1874625922401536:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1787782852.076416:0:11490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782852.076451:0:11490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312f10bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782852.076527:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922401536 00000100:00100000:0.0:1787782852.076536:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922401536 00000100:00100000:0.0:1787782852.076587:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787782852.076596:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31107430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11490:x1874625922401536:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787782852.076878:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31107430c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11490:x1874625922401536:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 283us (461us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787782852.076886:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787782852.094773:0:11490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3110740f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11490:1874625922401536:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1787782852.095034:0:11490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1787782852.095191:0:11490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6373db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.095203:0:11490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6373db lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.095211:0:11490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6373db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.095218:0:11490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f295600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782852.095222:0:11490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6373db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.095229:0:11490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6373db lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.095246:0:11490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef300) 00010000:00010000:0.0:1787782852.095249:0:11490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787782852.095433:0:11490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6373db lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.095454:0:11490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6373db lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787782852.095703:0:11490:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787782852.096477:0:11490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787782852.096495:0:11490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 336766398838ns, next at 337766394688ns, rc = 0 00000001:00080000:0.0:1787782852.096506:0:11490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1787782852.096560:0:11490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef300) 00010000:00010000:0.0:1787782852.096565:0:11490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787782852.096575:0:11490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6373c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5339 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782852.096717:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+26:10310:x1874625904540032:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 37926us (38094us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787782852.096728:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000020:00080000:0.0:1787782852.096735:0:11490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787782852.100575:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782852.100660:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904540288 00000100:00100000:1.0:1787782852.100671:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904540288 00000100:00100000:1.0:1787782852.100728:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:1.0:1787782852.100738:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31082583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+26:10310:x1874625904540288:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787782852.100764:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782852.100788:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b6373e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5340 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.100855:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b6373e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5340 expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.100871:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b6373e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5340 expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.100892:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:1.0:1787782852.100896:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787782852.100899:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6a00, rc 0) 00000100:00100000:1.0:1787782852.100969:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31082583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+27:10310:x1874625904540288:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 232us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782852.100976:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:3.0:1787782852.106964:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782852.107424:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904540544 00000100:00100000:2.0:1787782852.107434:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904540544 00000100:00100000:2.0:1787782852.107490:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:2.0:1787782852.107500:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310619cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+27:10310:x1874625904540544:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787782852.107807:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310619cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+28:10310:x1874625904540544:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 307us (851us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787782852.107816:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:0.0:1787782852.239088:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782852.240066:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904540800 00000100:00100000:3.0:1787782852.240089:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904540800 00000100:00100000:3.0:1787782852.240181:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:3.0:1787782852.240192:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+28:10320:x1874625904540800:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787782852.240224:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782852.240250:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6373e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5347 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782852.240382:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787782852.240523:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6373e9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5347 expref: 30 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.240540:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3108738800) 00010000:00010000:3.0:1787782852.240544:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787782852.240550:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6373e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5347 expref: 30 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.240566:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0600, rc 0) 00000100:00100000:3.0:1787782852.240647:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+29:10320:x1874625904540800:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 457us (1579us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1787782852.240656:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:3.0:1787782852.244584:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782852.244738:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904540928 00000100:00100000:0.0:1787782852.244748:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904540928 00000100:00100000:0.0:1787782852.244810:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:0.0:1787782852.244822:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31082592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+29:10320:x1874625904540928:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:0.0:1787782852.244892:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6373f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.244920:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6373f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.244933:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6373f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.244965:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6373fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.244973:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6373fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.244981:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6373fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245141:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637405 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245150:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245158:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787782852.245606:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245622:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6373f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245628:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6373f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245634:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6373f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245640:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782852.245645:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6373f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245661:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6373f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245675:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:0.0:1787782852.245678:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782852.245684:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6373f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245691:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6373f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245705:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6373fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245712:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6373fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245719:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6373fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245724:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782852.245727:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6373fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245733:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6373fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245741:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c310823c900) 00010000:00010000:0.0:1787782852.245744:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782852.245746:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6373fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245763:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6373fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245779:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637405 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245786:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637405 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245792:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245797:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782852.245800:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637405 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245807:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637405 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245815:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:0.0:1787782852.245817:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782852.245821:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637405 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.245826:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637405 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782852.246303:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31082592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+29:10320:x1874625904540928:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 1480us (1728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782852.246314:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:1.0:1787782852.258656:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782852.258795:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904541184 00000100:00100000:0.0:1787782852.258817:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904541184 00000100:00100000:0.0:1787782852.258883:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:0.0:1787782852.258895:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+29:10320:x1874625904541184:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787782852.259444:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+30:10320:x1874625904541184:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 550us (808us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787782852.259453:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:2.0:1787782852.330512:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782852.330629:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904541440 00000100:00100000:3.0:1787782852.330639:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904541440 00000100:00100000:3.0:1787782852.330704:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:3.0:1787782852.330730:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+30:10323:x1874625904541440:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787782852.330757:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782852.330779:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b63740c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e534e expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.330852:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b637413 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.330867:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b637413 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.330879:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b637413 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.330893:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63741a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.330899:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63741a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.330905:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63741a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331048:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637421 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331056:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331063:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782852.331148:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787782852.331242:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b637413 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331250:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b637413 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331257:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b637413 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331264:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782852.331268:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b637413 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331275:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b637413 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331289:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:3.0:1787782852.331293:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782852.331297:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b637413 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331304:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b637413 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331314:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63741a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331318:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63741a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331329:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63741a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331332:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782852.331334:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63741a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331338:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63741a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331343:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3104d6ed00) 00010000:00010000:3.0:1787782852.331344:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782852.331346:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63741a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331350:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63741a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331382:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b63740c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e534e expref: 33 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331390:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637421 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e534e expref: 32 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.331395:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:3.0:1787782852.331396:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787782852.331398:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0a00, rc 0) 00000100:00100000:0.0:1787782852.332400:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+32:10323:x1874625904541440:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1667us (1893us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1787782852.332411:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:3.0:1787782852.337705:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782852.337867:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904541568 00000100:00100000:0.0:1787782852.337878:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904541568 00000100:00100000:0.0:1787782852.337951:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:0.0:1787782852.337963:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108259680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+32:10323:x1874625904541568:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:0.0:1787782852.338042:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b63742f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.338056:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b63742f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.338066:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b63742f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.338129:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b63742f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.338136:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b63742f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.338144:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b63742f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.338166:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782852.338170:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b63742f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.338178:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b63742f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.338191:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:0.0:1787782852.338194:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787782852.338198:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b63742f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.338205:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b63742f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782852.338406:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108259680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+32:10323:x1874625904541568:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 444us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782852.338415:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:1.0:1787782852.348737:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782852.349937:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904541824 00000100:00100000:3.0:1787782852.349961:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904541824 00000100:00100000:3.0:1787782852.350021:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:3.0:1787782852.350030:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+32:10323:x1874625904541824:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:3.0:1787782852.350295:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+33:10323:x1874625904541824:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 264us (1567us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787782852.350304:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:2.0:1787782852.717266:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782852.717438:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904542080 00000100:00100000:0.0:1787782852.717448:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904542080 00000100:00100000:0.0:1787782852.717526:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:0.0:1787782852.717537:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+33:10354:x1874625904542080:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:0.0:1787782852.717566:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782852.717589:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637436 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5355 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.717700:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63743d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.717733:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63743d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.717745:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63743d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782852.717757:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787782852.717914:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637436 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5355 expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.717936:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63743d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5355 expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.717947:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:0.0:1787782852.717950:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787782852.717954:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255200, rc 0) 00000100:00100000:0.0:1787782852.718038:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+35:10354:x1874625904542080:12345-192.168.202.15@tcp:101:cat.0 Request processed in 503us (783us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787782852.718046:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:3.0:1787782852.729195:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782852.729356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782852.729832:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904542464 00000100:00100000:2.0:1787782852.729843:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904542464 00000100:00100000:2.0:1787782852.729897:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:2.0:1787782852.729906:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+35:10354:x1874625904542464:12345-192.168.202.15@tcp:35:cat.0 00000100:00100000:2.0:1787782852.730289:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+36:10354:x1874625904542464:12345-192.168.202.15@tcp:35:cat.0 Request processed in 382us (931us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787782852.730297:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:0.0:1787782852.737779:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904542208 00000100:00100000:0.0:1787782852.737794:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904542208 00000100:00100000:0.0:1787782852.737876:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:0.0:1787782852.737888:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+36:2349:x1874625904542208:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782852.737904:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782852.737929:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63743d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5355 expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.737983:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:0.0:1787782852.737988:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782852.738065:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+35:2349:x1874625904542208:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 180us (8880us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782852.738133:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:3.0:1787782852.831667:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782852.831910:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904542720 00000100:00100000:1.0:1787782852.831920:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904542720 00000100:00100000:1.0:1787782852.831984:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:1.0:1787782852.831994:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+35:10360:x1874625904542720:12345-192.168.202.15@tcp:101:dd.0 00010000:00010000:1.0:1787782852.832021:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782852.832037:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787782852.832065:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294800/0x6d98ed19b6373a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e532b expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.832139:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:1.0:1787782852.832145:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787782852.832162:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b63744b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e535c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.832260:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637452 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.832275:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637421 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e534e expref: 35 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.832283:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637452 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.832318:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637421 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e534e expref: 35 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.832333:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637421 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e534e expref: 35 pid: 6719 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782852.832348:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344ee580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1874625922401664:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782852.832455:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3132166a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787782852.835309:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344ee580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1874625922401664:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782852.835359:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637452 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782852.837940:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782852.839942:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904542848 00000100:00100000:1.0:1787782852.839956:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904542848 00010000:00010000:1.0:1787782852.840006:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637421 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e534e expref: 36 pid: 6719 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782852.840052:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:1.0:1787782852.840061:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+36:2350:x1874625904542848:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782852.840092:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782852.840121:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637421 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e534e expref: 36 pid: 6719 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.840135:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637421 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e534e expref: 36 pid: 6719 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.840158:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637421 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e534e expref: 36 pid: 6719 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.840177:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:1.0:1787782852.840181:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637452 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.840190:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637452 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.840197:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637452 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782852.840230:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782852.840310:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+35:2350:x1874625904542848:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 250us (2379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782852.840319:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 38 00010000:00010000:3.0:1787782852.840571:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637452 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.840582:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637452 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782852.840602:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787782852.840778:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b63744b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e535c expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.840794:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637452 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e535c expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782852.840801:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:3.0:1787782852.840804:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787782852.840807:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7a00, rc 0) 00000100:00100000:3.0:1787782852.840835:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+35:10360:x1874625904542720:12345-192.168.202.15@tcp:101:dd.0 Request processed in 8843us (9178us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787782852.840855:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:3.0:1787782852.852363:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782852.852471:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904543104 00000100:00100000:0.0:1787782852.852481:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904543104 00000100:00100000:0.0:1787782852.852608:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:0.0:1787782852.852619:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+35:10360:x1874625904543104:12345-192.168.202.15@tcp:36:dd.0 00010000:00010000:0.0:1787782852.854819:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637460 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.854842:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637460 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782852.854854:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637460 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787782852.854909:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1787782852.854931:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dff40502 reply state 0000000060aa2cc0 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637460 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782852.854940:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787782852.855079:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+38:10360:x1874625904543104:12345-192.168.202.15@tcp:36:dd.0 Request processed in 2446us (2711us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787782852.855088:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 52 00000020:00080000:0.0:1787782852.855128:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787782852.862250:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637460 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.862285:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637460 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.862294:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637460 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.862300:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782852.862305:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637460 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.862314:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637460 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.862332:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:2.0:1787782852.862335:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782852.862340:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637460 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.862347:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637460 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782852.964164:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782853.219331:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874625922402048:0@lo:400:kworker.0 00000100:00100000:1.0:1787782853.219395:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782853.219458:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787782853.219472:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922401920:0@lo:400:kworker.0 00000100:00100000:1.0:1787782853.219494:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782853.219509:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922402432:0@lo:400:kworker.0 00000100:00100000:1.0:1787782853.219532:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782853.219564:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922402048 00000100:00100000:1.0:1787782853.219570:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922402048 00000100:00100000:1.0:1787782853.219614:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922401920 00000100:00100000:1.0:1787782853.219618:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922401920 00000100:00100000:1.0:1787782853.219639:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787782853.219647:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874625922402048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782853.219691:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874625922402048:12345-0@lo:400:kworker.0 Request processed in 45us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782853.219698:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787782853.219714:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787782853.219719:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922401920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782853.219741:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922401920:12345-0@lo:400:kworker.0 Request processed in 23us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782853.219747:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1787782853.219761:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782853.219786:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922401920:0@lo:400:kworker.0 00000100:00100000:1.0:1787782853.219804:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874625922402048:0@lo:400:kworker.0 00000100:00100000:2.0:1787782853.220037:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922401792:0@lo:400:kworker.0 00000100:00100000:2.0:1787782853.220085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782853.220151:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922402304:0@lo:400:kworker.0 00000100:00100000:2.0:1787782853.220173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782853.220190:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787782853.220195:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922402176:0@lo:400:kworker.0 00000100:00100000:2.0:1787782853.220215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782853.220251:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922402432 00000100:00100000:2.0:1787782853.220257:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922402176 00000100:00100000:2.0:1787782853.220261:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922402176 00000100:00100000:0.0:1787782853.220265:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922402432 00000100:00100000:1.0:1787782853.220339:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922401792 00000100:00100000:1.0:1787782853.220344:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922401792 00000100:00100000:1.0:1787782853.220372:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1787782853.220379:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922401792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782853.220422:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922401792:12345-0@lo:400:kworker.0 Request processed in 43us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782853.220428:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:1.0:1787782853.220469:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782853.220476:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922402304 00000100:00100000:1.0:1787782853.220480:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922402304 00000100:00100000:1.0:1787782853.220504:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787782853.220510:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110742d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922402304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782853.220536:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110742d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922402304:12345-0@lo:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782853.220542:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1787782853.220554:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782853.220587:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787782853.220595:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31107403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922402176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782853.220624:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31107403c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922402176:12345-0@lo:400:kworker.0 Request processed in 31us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782853.220630:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787782853.220641:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787782853.220646:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922402432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782853.220672:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922402432:12345-0@lo:400:kworker.0 Request processed in 27us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782853.220678:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787782853.220769:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922402176:0@lo:400:kworker.0 00000100:00100000:3.0:1787782853.220778:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922401792:0@lo:400:kworker.0 00000100:00100000:3.0:1787782853.220786:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922402304:0@lo:400:kworker.0 00000100:00100000:3.0:1787782853.220813:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922402432:0@lo:400:kworker.0 00000100:00100000:3.0:1787782853.326431:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782853.326843:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904543232 00000100:00100000:0.0:1787782853.326853:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904543232 00000100:00100000:0.0:1787782853.326916:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:0.0:1787782853.326925:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108259a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+37:10374:x1874625904543232:12345-192.168.202.15@tcp:101:stat.0 00010000:00010000:0.0:1787782853.326959:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782853.326979:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637467 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5363 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.327049:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63746e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.327074:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63746e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.327086:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63746e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.327143:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637475 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.327152:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.327159:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.327529:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63747c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.327541:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637452 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e535c expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.327569:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63747c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.327606:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637452 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e535c expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.327621:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637452 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e535c expref: 38 pid: 5851 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782853.327636:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922402560:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787782853.327730:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3108f073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782853.332536:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922402560:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787782853.332537:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:2.0:1787782853.332569:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63747c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782853.332579:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904543488 00000100:00100000:3.0:1787782853.332587:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904543488 00000100:00100000:3.0:1787782853.332654:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:3.0:1787782853.332663:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108258f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+39:5587:x1874625904543488:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787782853.333411:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108258f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+40:5587:x1874625904543488:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 747us (883us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1787782853.333420:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:3.0:1787782853.348861:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782853.349024:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904543616 00000100:00100000:0.0:1787782853.349033:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904543616 00010000:00010000:0.0:1787782853.349139:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637452 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e535c expref: 40 pid: 5851 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782853.349216:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:0.0:1787782853.349227:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108259e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+40:2350:x1874625904543616:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782853.349252:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782853.349259:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637452 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e535c expref: 40 pid: 5851 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.349273:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637452 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e535c expref: 40 pid: 5851 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.349296:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637452 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e535c expref: 40 pid: 5851 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.349324:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:0.0:1787782853.349331:0:7637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63747c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.349340:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63747c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.349349:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63747c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.349376:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782853.349408:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63747c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.349420:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63747c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782853.349438:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108259e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+39:2350:x1874625904543616:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 211us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782853.349446:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00000004:00200000:2.0:1787782853.349467:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787782853.349472:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782853.349634:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63747c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.349650:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63747c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.349680:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63746e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.349688:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63746e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.349695:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63746e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.349701:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782853.349706:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63746e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.349713:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63746e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.349724:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:2.0:1787782853.349727:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782853.349730:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63746e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.349737:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63746e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.349747:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.349753:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637475 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.349759:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.349769:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782853.349772:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.349779:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637475 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.349786:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c310823c900) 00010000:00010000:2.0:1787782853.349789:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782853.349792:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637475 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.349798:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637475 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.350510:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637467 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5363 expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.350529:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63747c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5363 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782853.350545:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:2.0:1787782853.350548:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787782853.350551:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255200, rc 0) 00000100:00100000:3.0:1787782853.350644:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108259a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+38:10374:x1874625904543232:12345-192.168.202.15@tcp:101:stat.0 Request processed in 23718us (24222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782853.350654:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:3.0:1787782853.445665:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782853.445787:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904543872 00000100:00100000:1.0:1787782853.445806:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904543872 00000100:00100000:1.0:1787782853.445903:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 54 00000100:00100000:1.0:1787782853.445914:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+38:10380:x1874625904543872:12345-192.168.202.15@tcp:36:truncate.0 00010000:00010000:1.0:1787782853.445978:0:6719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782853.446009:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b63747c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5363 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.446027:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:1.0:1787782853.446046:0:6719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787782853.446338:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637483 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.446352:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.446363:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787782853.446430:0:6719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1787782853.446575:0:6719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f4ca43f reply state 000000005823f654 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782853.446584:0:6719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787782853.447200:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+40:10380:x1874625904543872:12345-192.168.202.15@tcp:36:truncate.0 Request processed in 1284us (1542us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787782853.447210:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 54 00000020:00080000:1.0:1787782853.447217:0:6719:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787782853.452569:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.452591:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637483 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.452599:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637483 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.452606:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782853.452611:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637483 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.452620:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637483 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.452656:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:1.0:1787782853.452659:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782853.452664:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637483 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.452670:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637483 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782853.615206:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782853.615556:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904544000 00000100:00100000:1.0:1787782853.615566:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904544000 00000100:00100000:1.0:1787782853.615623:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:1.0:1787782853.615633:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+39:10394:x1874625904544000:12345-192.168.202.15@tcp:101:stat.0 00010000:00010000:1.0:1787782853.615659:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782853.615681:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b63748a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e536a expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.615745:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637491 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.615759:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.615771:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.615785:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637498 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.615792:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.615817:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.615914:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b63749f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.615923:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b63749f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.615930:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b63749f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782853.615969:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787782853.615974:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787782853.615997:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b63749f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616008:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b63749f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616016:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616022:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637491 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616029:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616035:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782853.616040:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616055:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637491 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616079:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:1.0:1787782853.616082:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782853.616087:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637491 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616125:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637491 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616140:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616146:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637498 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616153:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616157:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782853.616160:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616167:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637498 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616173:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c312eeef000) 00010000:00010000:1.0:1787782853.616176:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782853.616178:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637498 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616193:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637498 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616223:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b63748a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e536a expref: 41 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616235:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b63749f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e536a expref: 40 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.616243:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:1.0:1787782853.616245:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782853.616247:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7e00, rc 0) 00000100:00100000:1.0:1787782853.616425:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+40:10394:x1874625904544000:12345-192.168.202.15@tcp:101:stat.0 Request processed in 792us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782853.616432:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:2.0:1787782853.668241:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782853.668477:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904544256 00000100:00100000:3.0:1787782853.668486:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904544256 00000100:00100000:3.0:1787782853.668605:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:3.0:1787782853.668615:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+40:10404:x1874625904544256:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787782853.668635:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782853.668655:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6374a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5371 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782853.668765:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787782853.668872:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6374a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5371 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.668886:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3108738800) 00010000:00010000:3.0:1787782853.668889:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787782853.668894:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6374a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5371 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.668908:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0600, rc 0) 00000100:00100000:3.0:1787782853.668982:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+41:10404:x1874625904544256:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 368us (753us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1787782853.668989:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:2.0:1787782853.670792:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782853.670854:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904544512 00000100:00100000:3.0:1787782853.670861:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904544512 00000100:00100000:3.0:1787782853.670905:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:3.0:1787782853.670913:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+41:10404:x1874625904544512:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:3.0:1787782853.671169:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+42:10404:x1874625904544512:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 255us (383us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787782853.671177:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000004:00080000:0.0:1787782853.729443:0:8012:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 338399343658ns, next at 339399341238ns, rc = 0 00000100:00100000:3.0:1787782853.729522:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922402688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782853.729606:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782853.729822:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922402688 00000100:00100000:2.0:1787782853.729831:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922402688 00000100:00100000:2.0:1787782853.729879:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787782853.729894:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922402688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787782853.729930:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787782853.729984:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108258000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922402688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782853.729998:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787782853.730772:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922402688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782853.730839:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922402816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782853.730882:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782853.731378:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922402816 00000100:00100000:1.0:1787782853.731384:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922402816 00000100:00100000:1.0:1787782853.731421:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787782853.731429:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108258b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922402816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782853.731457:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782853.731512:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108258b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922402816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782853.731518:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787782853.731589:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922402816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782853.757342:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782853.757432:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904544768 00000100:00100000:3.0:1787782853.757441:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904544768 00000100:00100000:3.0:1787782853.757497:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:3.0:1787782853.757507:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+42:10410:x1874625904544768:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787782853.757532:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782853.757552:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6374b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5378 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.757659:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.757673:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b63749f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e536a expref: 43 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.757682:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374bb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.757715:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b63749f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e536a expref: 43 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.757769:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b63749f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e536a expref: 43 pid: 5853 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782853.757784:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3108258780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922402944:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787782853.757894:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3109a77c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787782853.760708:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3108258780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922402944:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787782853.760739:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782853.767742:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782853.767825:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904544896 00000100:00100000:3.0:1787782853.767835:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904544896 00010000:00010000:3.0:1787782853.767876:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b63749f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e536a expref: 44 pid: 5853 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782853.767915:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:3.0:1787782853.767931:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+44:2350:x1874625904544896:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782853.767947:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782853.767953:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b63749f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e536a expref: 44 pid: 5853 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.767966:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b63749f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e536a expref: 44 pid: 5853 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.767989:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b63749f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e536a expref: 44 pid: 5853 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.768005:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:3.0:1787782853.768011:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.768020:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.768029:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374bb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.768082:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782853.768176:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+43:2350:x1874625904544896:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 252us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782853.768183:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 40 00010000:00010000:0.0:1787782853.768291:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.768308:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782853.768326:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787782853.768472:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6374b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5378 expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.768494:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5378 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782853.768501:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:0.0:1787782853.768504:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787782853.768506:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1600, rc 0) 00000100:00100000:0.0:1787782853.768530:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+43:10410:x1874625904544768:12345-192.168.202.15@tcp:101:bash.0 Request processed in 11025us (11199us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787782853.768537:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:0.0:1787782853.772869:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782853.772953:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904545152 00000100:00100000:1.0:1787782853.772962:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904545152 00000100:00100000:1.0:1787782853.773024:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00100000:1.0:1787782853.773032:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+43:10410:x1874625904545152:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:1.0:1787782853.773355:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6374c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.773373:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6374c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.773385:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6374c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787782853.773430:0:6719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1787782853.773450:0:6719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1329302 reply state 0000000056607cd4 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6374c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782853.773458:0:6719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787782853.773535:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+46:10410:x1874625904545152:12345-192.168.202.15@tcp:36:bash.0 Request processed in 503us (676us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787782853.773542:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 58 00000020:00080000:1.0:1787782853.773547:0:6719:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787782853.775193:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6374c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.775209:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6374c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.775216:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6374c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.775223:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782853.775228:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6374c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.775235:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6374c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.775251:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:3.0:1787782853.775254:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782853.775258:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6374c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.775265:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6374c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782853.779612:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782853.780419:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904545280 00000100:00100000:1.0:1787782853.780429:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904545280 00000100:00100000:1.0:1787782853.780490:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:1.0:1787782853.780499:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+45:10410:x1874625904545280:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787782853.780526:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782853.780547:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b6374d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e537f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.780641:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b6374d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.780656:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374bb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5378 expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.780676:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b6374d7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.780712:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5378 expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.780726:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5378 expref: 46 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782853.780740:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc04780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922403072:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782853.780820:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3132166600 going to sleep for 11 seconds 00000100:00100000:1.0:1787782853.783354:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc04780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922403072:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782853.783385:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b6374d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782853.784955:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782853.785151:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904545408 00000100:00100000:3.0:1787782853.785208:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904545408 00010000:00010000:3.0:1787782853.785261:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5378 expref: 47 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782853.785333:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:3.0:1787782853.785342:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+47:2350:x1874625904545408:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782853.785357:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782853.785363:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5378 expref: 47 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.785376:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5378 expref: 47 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.785398:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5378 expref: 47 pid: 5852 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.785414:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:3.0:1787782853.785419:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b6374d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.785429:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b6374d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.785437:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b6374d7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.785465:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782853.785520:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+46:2350:x1874625904545408:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 179us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782853.785527:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 41 00010000:00010000:1.0:1787782853.787727:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b6374d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.787746:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b6374d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782853.787799:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787782853.787804:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787782853.787829:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b6374d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.787875:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b6374d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e537f expref: 46 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.787938:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b6374d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e537f expref: 45 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.787948:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:1.0:1787782853.787951:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782853.787955:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7c00, rc 0) 00000100:00100000:1.0:1787782853.788042:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+45:10410:x1874625904545280:12345-192.168.202.15@tcp:101:bash.0 Request processed in 7543us (8440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782853.788050:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:0.0:1787782853.792230:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782853.792582:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904545664 00000100:00100000:3.0:1787782853.792592:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904545664 00000100:00100000:3.0:1787782853.792647:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:3.0:1787782853.792656:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310619d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+45:10410:x1874625904545664:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:3.0:1787782853.792950:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310619d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+46:10410:x1874625904545664:12345-192.168.202.15@tcp:35:bash.0 Request processed in 294us (729us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1787782853.792958:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:2.0:1787782853.895591:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782853.895690:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904545920 00000100:00100000:1.0:1787782853.895700:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904545920 00000100:00100000:1.0:1787782853.895778:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:1.0:1787782853.895787:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+46:10420:x1874625904545920:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787782853.895812:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782853.895846:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b6374de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5386 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782853.896217:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787782853.896341:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b6374de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5386 expref: 48 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.896358:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3108738800) 00010000:00010000:1.0:1787782853.896361:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787782853.896367:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b6374de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5386 expref: 48 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.896402:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7a00, rc 0) 00000100:00100000:1.0:1787782853.896475:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+47:10420:x1874625904545920:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 688us (895us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1787782853.896483:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:0.0:1787782853.901921:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782853.902182:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904546048 00000100:00100000:3.0:1787782853.902192:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904546048 00000100:00100000:3.0:1787782853.902282:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:3.0:1787782853.902293:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+47:10420:x1874625904546048:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:3.0:1787782853.902377:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902393:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902412:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902426:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6374f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902432:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6374f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902438:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6374f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902535:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6374fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902556:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6374fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902564:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6374fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787782853.902610:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6374fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902622:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902628:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902634:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902639:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782853.902643:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902650:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902661:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:3.0:1787782853.902664:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782853.902668:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902673:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b6374ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902693:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6374f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902698:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6374f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902704:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6374f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902708:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782853.902711:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6374f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902716:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6374f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902722:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3104d6ed00) 00010000:00010000:3.0:1787782853.902724:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782853.902726:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6374f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902731:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6374f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902742:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6374fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.902747:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6374fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.903523:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6374fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.903537:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782853.903540:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6374fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.903547:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6374fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.903557:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:3.0:1787782853.903559:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782853.903563:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6374fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.903568:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b6374fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782853.903708:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+47:10420:x1874625904546048:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 1415us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782853.903718:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:0.0:1787782853.909035:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782853.909133:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904546304 00000100:00100000:2.0:1787782853.909143:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904546304 00000100:00100000:2.0:1787782853.909199:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:2.0:1787782853.909210:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+47:10420:x1874625904546304:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787782853.909458:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+48:10420:x1874625904546304:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 251us (432us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787782853.909467:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:2.0:1787782853.935000:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782853.937052:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904546560 00000100:00100000:1.0:1787782853.937075:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904546560 00000100:00100000:1.0:1787782853.937170:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:1.0:1787782853.937180:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+48:10423:x1874625904546560:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787782853.937205:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782853.937226:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637501 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e538d expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937294:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637508 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937307:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637508 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937318:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637508 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937334:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63750f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937341:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63750f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937347:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63750f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937487:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637516 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937495:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937502:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782853.937511:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787782853.937598:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637508 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937606:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637508 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937612:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637508 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937618:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782853.937622:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637508 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937629:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637508 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937641:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:1.0:1787782853.937644:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782853.937648:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637508 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937654:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637508 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937675:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63750f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937680:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63750f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937686:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63750f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937691:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782853.937694:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63750f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937700:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63750f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937707:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c312eeef000) 00010000:00010000:1.0:1787782853.937709:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782853.937712:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63750f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937717:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b63750f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937757:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637501 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e538d expref: 51 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937770:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e538d expref: 50 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.937787:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:1.0:1787782853.937790:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782853.937792:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6200, rc 0) 00000100:00100000:1.0:1787782853.937873:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+50:10423:x1874625904546560:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 682us (2871us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1787782853.937882:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:2.0:1787782853.941573:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782853.941644:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782853.941703:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904546816 00000100:00100000:3.0:1787782853.941713:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904546816 00000100:00100000:3.0:1787782853.941779:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:3.0:1787782853.941788:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+50:2350:x1874625904546816:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782853.941806:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782853.941834:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637516 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e538d expref: 50 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782853.941853:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:3.0:1787782853.941858:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782853.941927:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+49:2350:x1874625904546816:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 140us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782853.941935:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:1.0:1787782853.942331:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904546688 00000100:00100000:1.0:1787782853.942336:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904546688 00000100:00100000:1.0:1787782853.942397:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:1.0:1787782853.942404:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+49:10423:x1874625904546688:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:1.0:1787782853.942462:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.942478:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.942489:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.942521:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.942528:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637524 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.942534:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.942540:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782853.942554:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.942562:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637524 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.942571:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:1.0:1787782853.942574:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787782853.942577:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637524 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782853.942583:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782853.942662:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+49:10423:x1874625904546688:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 258us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782853.942669:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:2.0:1787782853.951236:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782853.955194:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904547072 00000100:00100000:3.0:1787782853.955211:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904547072 00000100:00100000:3.0:1787782853.955295:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:3.0:1787782853.955305:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+49:10423:x1874625904547072:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:3.0:1787782853.955628:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+50:10423:x1874625904547072:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 324us (4403us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1787782853.955636:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00010000:00010000:0.0:1787782853.985341:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782854.098152:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782854.098263:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904547328 00000100:00100000:1.0:1787782854.098273:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904547328 00000100:00100000:1.0:1787782854.098351:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:1.0:1787782854.098362:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+50:10441:x1874625904547328:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:1.0:1787782854.098387:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782854.098411:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63752b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5394 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.098514:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637532 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.098530:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637532 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.098561:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637532 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782854.098574:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787782854.098708:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63752b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5394 expref: 53 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.098728:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637532 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5394 expref: 52 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.098738:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:1.0:1787782854.098742:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787782854.098757:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7a00, rc 0) 00000100:00100000:1.0:1787782854.098827:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+52:10441:x1874625904547328:12345-192.168.202.15@tcp:101:cat.0 Request processed in 467us (687us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787782854.098835:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00080000:2.0:1787782854.099186:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782854.129864:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782854.129960:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904547456 00000100:00100000:3.0:1787782854.129969:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904547456 00000100:00100000:3.0:1787782854.130031:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:3.0:1787782854.130041:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+52:10442:x1874625904547456:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787782854.130072:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782854.130130:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637540 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e539b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.130198:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b637547 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.130212:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b637547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.130223:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b637547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782854.130293:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787782854.130297:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787782854.130336:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b637547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.130362:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637540 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e539b expref: 54 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.130377:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b637547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e539b expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.130385:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:3.0:1787782854.130388:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787782854.130392:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1a00, rc 0) 00000100:00100000:3.0:1787782854.130452:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+53:10442:x1874625904547456:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 412us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782854.130459:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:0.0:1787782854.137674:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782854.137787:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904547840 00000100:00100000:2.0:1787782854.137797:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904547840 00000100:00100000:2.0:1787782854.137887:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:2.0:1787782854.137897:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+53:10442:x1874625904547840:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787782854.138432:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+54:10442:x1874625904547840:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 535us (766us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787782854.138460:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:0.0:1787782854.141210:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782854.141475:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904547968 00000100:00100000:1.0:1787782854.141485:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904547968 00000100:00100000:1.0:1787782854.141545:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:1.0:1787782854.141556:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+54:10442:x1874625904547968:12345-192.168.202.15@tcp:103:lfs.0 00010000:00010000:1.0:1787782854.141572:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787782854.141597:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b6374d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e537f expref: 54 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.141618:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637532 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5394 expref: 53 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.141651:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b6373e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5340 expref: 52 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.141672:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:1.0:1787782854.141683:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782854.141735:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+51:10442:x1874625904547968:12345-192.168.202.15@tcp:103:lfs.0 Request processed in 181us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782854.141742:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:0.0:1787782854.145178:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782854.145311:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904548096 00000100:00100000:3.0:1787782854.145321:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904548096 00000100:00100000:3.0:1787782854.145422:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:3.0:1787782854.145432:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+51:10442:x1874625904548096:12345-192.168.202.15@tcp:58:lfs.0 00010000:00010000:3.0:1787782854.145558:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b63754e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.145575:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b63754e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.145587:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b63754e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787782854.145888:0:5851:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787782854.146386:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1787782854.146469:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1787782854.146577:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+51:10442:x1874625904548096:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 1143us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782854.146586:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:0.0:1787782854.188402:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782854.188526:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904548224 00000100:00100000:1.0:1787782854.188536:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904548224 00000100:00100000:1.0:1787782854.188591:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:1.0:1787782854.188598:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+51:10444:x1874625904548224:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787782854.188616:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782854.188640:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637555 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e53a2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188712:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b63755c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188724:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b63755c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188732:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b63755c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188742:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637563 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188763:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188767:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188845:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63756a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188850:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63756a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188854:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63756a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782854.188882:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787782854.188885:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787782854.188898:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63756a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188906:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63756a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188911:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b63755c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188916:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b63755c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188928:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b63755c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188938:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782854.188942:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b63755c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188952:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b63755c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188965:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:1.0:1787782854.188968:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782854.188972:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b63755c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188978:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b63755c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188991:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.188997:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637563 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.189004:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637563 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.189009:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782854.189011:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637563 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.189017:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637563 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.189036:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c312eeef100) 00010000:00010000:1.0:1787782854.189048:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782854.189052:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637563 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.189068:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637563 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.189727:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637555 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53a2 expref: 53 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.189759:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63756a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53a2 expref: 52 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.189768:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3104d6ed00) 00010000:00010000:1.0:1787782854.189771:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787782854.189774:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6400, rc 0) 00000100:00100000:1.0:1787782854.189847:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+52:10444:x1874625904548224:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1248us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782854.189856:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 67 00000040:00080000:1.0:1787782854.950298:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787782854.950308:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787782854.950366:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787782854.950384:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787782854.950543:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc04780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874625922403200:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787782854.950638:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106d8d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787782854.957971:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc04780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874625922403200:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787782854.960233:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782854.960379:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904548352 00000100:00100000:2.0:1787782854.960389:0:5863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904548352 00000100:00100000:2.0:1787782854.960438:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:2.0:1787782854.960447:0:5863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e4b0e72-6952-496d-b228-ab2778cd786f+52:10455:x1874625904548352:12345-192.168.202.15@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787782854.960522:0:5863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6e4b0e72-6952-496d-b228-ab2778cd786f+52:10455:x1874625904548352:12345-192.168.202.15@tcp:900:lhsmtool_posix.0 Request processed in 76us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782854.960530:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:0.0:1787782854.962717:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782854.962769:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904548480 00000100:00100000:2.0:1787782854.962778:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904548480 00000100:00100000:2.0:1787782854.962826:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:2.0:1787782854.962835:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+52:10455:x1874625904548480:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787782854.962861:0:6719:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787782854.962968:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+52:10455:x1874625904548480:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 133us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782854.962979:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:3.0:1787782854.968018:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782854.968199:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904548608 00000100:00100000:0.0:1787782854.968211:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904548608 00000100:00100000:2.0:1787782854.969361:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:3.0:1787782854.969497:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108258f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+52:10455:x1874625904548608:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787782854.969571:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637571 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969587:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637571 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969602:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637571 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969638:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637578 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969647:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637578 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969654:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637578 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969681:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b63757f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969689:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b63757f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969695:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b63757f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782854.969743:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787782854.969747:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787782854.969761:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b63757f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969771:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637571 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969778:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637571 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969786:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637571 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969792:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782854.969795:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637571 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969803:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637571 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969814:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c312eeef700) 00010000:00010000:3.0:1787782854.969817:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782854.969822:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637571 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969828:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637571 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969841:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637578 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969856:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637578 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969862:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637578 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969867:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782854.969870:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637578 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969875:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637578 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969881:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8c3104d6ec00) 00010000:00010000:3.0:1787782854.969884:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782854.969886:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637578 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969892:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637578 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969904:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b63757f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.969910:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b63757f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.970508:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b63757f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.970515:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782854.970524:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b63757f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.970532:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b63757f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.970543:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3104d6ed00) 00010000:00010000:3.0:1787782854.970546:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782854.970549:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b63757f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.970556:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b63757f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782854.970682:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108258f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+52:10455:x1874625904548608:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 Request processed in 1244us (2670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782854.973321:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:0.0:1787782854.973424:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782854.973460:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904548864 00000100:00100000:3.0:1787782854.973468:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904548864 00000100:00100000:3.0:1787782854.973518:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00100000:3.0:1787782854.973524:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+52:10455:x1874625904548864:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787782854.973541:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782854.973556:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637586 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e53a9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.973642:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63758d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.973654:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63758d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.973669:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63758d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782854.973678:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787782854.973753:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63758d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.973759:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63758d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.973763:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63758d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.973767:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782854.973769:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63758d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.973775:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63758d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.973783:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3104d6ed00) 00010000:00010000:3.0:1787782854.973785:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787782854.973788:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63758d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.973791:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63758d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.973821:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637586 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53a9 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.973836:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c312eeef700) 00010000:00010000:3.0:1787782854.973838:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787782854.973840:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637586 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53a9 expref: 54 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.973847:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0000, rc 0) 00000100:00100000:3.0:1787782854.973896:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+53:10455:x1874625904548864:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 372us (475us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1787782854.973900:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00100000:2.0:1787782854.976820:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782854.977008:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904548992 00000100:00100000:0.0:1787782854.977018:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904548992 00000100:00100000:0.0:1787782854.977121:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00100000:0.0:1787782854.977130:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+53:10455:x1874625904548992:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787782854.977162:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787782854.977274:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+53:10455:x1874625904548992:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 145us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782854.977282:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00100000:0.0:1787782854.985743:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782854.985969:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904549248 00000100:00100000:1.0:1787782854.985978:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904549248 00000100:00100000:1.0:1787782854.986038:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:1.0:1787782854.986058:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+53:10455:x1874625904549248:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787782854.986081:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782854.986108:0:6719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787782854.986134:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b637547 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e539b expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.986152:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:1.0:1787782854.986157:0:6719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787782854.986172:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b63759b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e53b0 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787782854.986595:0:6719:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787782854.986797:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b6375a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.986810:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b6375a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.986820:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b6375a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.986882:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b63759b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53b0 expref: 55 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.986897:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b6375a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53b0 expref: 54 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782854.986910:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:1.0:1787782854.986913:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782854.986916:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7800, rc 0) 00000100:00100000:1.0:1787782854.986974:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+54:10455:x1874625904549248:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 927us (1240us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787782854.986982:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:1.0:1787782854.989665:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782854.991398:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904549504 00000100:00100000:3.0:1787782854.991410:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904549504 00000100:00100000:3.0:1787782854.991475:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 73 00000100:00100000:3.0:1787782854.991486:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+54:10455:x1874625904549504:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787782854.991540:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782854.991564:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b6375a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53b0 expref: 54 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991580:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:3.0:1787782854.991591:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787782854.991613:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6375b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991626:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6375b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991635:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6375b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991659:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b6375b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x402fae9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991667:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b6375b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x402fae9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991674:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b6375b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x402fae9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991744:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6375b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991751:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6375b0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991758:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6375b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991765:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782854.991769:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6375b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991776:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6375b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991785:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:3.0:1787782854.991788:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782854.991792:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6375b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991797:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6375b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991815:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b6375b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x402fae9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991821:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b6375b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x402fae9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991826:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b6375b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x402fae9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991830:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782854.991833:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b6375b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x402fae9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991839:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b6375b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x402fae9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991846:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x402fae9 (ffff8c3104d6ec00) 00010000:00010000:3.0:1787782854.991848:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782854.991851:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b6375b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x402fae9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782854.991856:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b6375b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x402fae9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782854.996475:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+53:10455:x1874625904549504:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 4983us (6811us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787782854.996486:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 73 00000100:00100000:2.0:1787782855.001433:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782855.001532:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904549632 00000100:00100000:0.0:1787782855.001543:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904549632 00000100:00100000:0.0:1787782855.001605:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 74 00000100:00100000:0.0:1787782855.001617:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+53:10455:x1874625904549632:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787782855.001643:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782855.001671:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6375be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e53b7 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.001711:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6375c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.001726:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6375c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.001738:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6375c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.001830:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6375be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53b7 expref: 55 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.001847:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6375c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53b7 expref: 54 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.001863:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c310823c000) 00010000:00010000:0.0:1787782855.001866:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787782855.001870:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254400, rc 0) 00000100:00100000:0.0:1787782855.002032:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+54:10455:x1874625904549632:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 416us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782855.002040:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 74 00000100:00100000:0.0:1787782855.007045:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782855.007134:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904549888 00000100:00100000:0.0:1787782855.007147:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904549888 00000100:00100000:0.0:1787782855.007207:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 75 00000100:00100000:0.0:1787782855.007218:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+54:10455:x1874625904549888:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787782855.007298:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b6375cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.007312:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b6375cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.007322:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b6375cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787782855.007606:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1787782855.007614:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 339677518364ns, next at 340677516916ns, rc = 0 00000004:00010000:0.0:1787782855.007694:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d24de41 reply state 00000000a6b9af96 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b6375cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782855.007701:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787782855.007779:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+56:10455:x1874625904549888:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 561us (749us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787782855.007791:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 75 00000040:00080000:2.0:1787782855.012026:0:12008:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787782855.012038:0:12008:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:0.0:1787782855.012325:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b6375cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.012339:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b6375cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.012348:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b6375cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.012355:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782855.012360:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b6375cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.012368:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b6375cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.012386:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c310823c000) 00010000:00010000:0.0:1787782855.012390:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787782855.012394:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b6375cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.012401:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b6375cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782855.012516:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782855.012587:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904550016 00000100:00100000:3.0:1787782855.012714:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904550016 00000100:00100000:3.0:1787782855.012769:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:3.0:1787782855.012781:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+55:10455:x1874625904550016:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787782855.012807:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782855.012832:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6375d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e53be expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.012893:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6375d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53be expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.012908:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6375d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53be expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.012928:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c310823c000) 00010000:00010000:3.0:1787782855.012931:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787782855.012933:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1c00, rc 0) 00000100:00100000:3.0:1787782855.012985:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+56:10455:x1874625904550016:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 206us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782855.012993:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 76 00010000:00010000:0.0:1787782855.013326:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787782855.015738:0:12008:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787782855.015756:0:12008:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787782855.019264:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782855.022193:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904550144 00000100:00100000:3.0:1787782855.022206:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904550144 00000100:00100000:3.0:1787782855.022255:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:3.0:1787782855.022263:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1874625904550144:12345-192.168.202.15@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787782855.022294:0:6696:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:3.0:1787782855.022336:0:6696:0:(genops.c:1385:class_connect()) connect: client 6e4b0e72-6952-496d-b228-ab2778cd786f, cookie 0x6d98ed19b6375da 00002000:00100000:3.0:1787782855.022348:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e4b0e72-6952-496d-b228-ab2778cd786f/ffff8c3106df3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113937 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787782855.022359:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787782855.022595:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787782855.022630:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8c3106df2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787782855.022716:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2348:x1874625904550144:12345-192.168.202.15@tcp:8:lhsmtool_posix.0 Request processed in 451us (3462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782855.022735:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:0.0:1787782855.026384:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782855.026456:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904550272 00000100:00100000:2.0:1787782855.026464:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904550272 00000100:00100000:2.0:1787782855.026546:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:2.0:1787782855.026556:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:0:x1874625904550272:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787782855.032452:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787782855.089573:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+7:0:x1874625904550272:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 63007us (63182us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787782855.089588:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 25 00000001:00080000:1.0:1787782855.089727:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1787782855.089741:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e4b0e72-6952-496d-b228-ab2778cd786f 00000100:00100000:3.0:1787782855.101876:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782855.101932:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904550528 00000100:00100000:3.0:1787782855.101942:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904550528 00000100:00100000:3.0:1787782855.102011:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:3.0:1787782855.102023:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+56:10455:x1874625904550528:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787782855.102486:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+57:10455:x1874625904550528:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 464us (620us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787782855.102496:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:2.0:1787782855.108297:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782855.108381:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904550784 00000100:00100000:0.0:1787782855.108392:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904550784 00000100:00100000:0.0:1787782855.108453:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:0.0:1787782855.108476:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+57:10455:x1874625904550784:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787782855.108593:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+57:10455:x1874625904550784:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 118us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782855.108600:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:0.0:1787782855.116257:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782855.116345:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904550912 00000100:00100000:3.0:1787782855.116356:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904550912 00000100:00100000:3.0:1787782855.116426:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 78 00000100:00100000:3.0:1787782855.116437:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+57:10455:x1874625904550912:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787782855.116458:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782855.116479:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b6375e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e53c5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.116558:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6375e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.116575:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6375e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.116587:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6375e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782855.116625:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787782855.116663:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6375e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.116691:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b6375e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53c5 expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.116708:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6375e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53c5 expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.116717:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c310823c000) 00010000:00010000:3.0:1787782855.116719:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787782855.116724:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0000, rc 0) 00000100:00100000:3.0:1787782855.116787:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+58:10455:x1874625904550912:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 352us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782855.116794:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 78 00000100:00100000:3.0:1787782855.123635:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782855.123722:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904551040 00000100:00100000:1.0:1787782855.123734:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904551040 00000100:00100000:1.0:1787782855.123810:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:1.0:1787782855.123821:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108258780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2350:x1874625904551040:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787782855.123845:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782855.123873:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b6375ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e53cc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787782855.123903:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f66c7, blocks: 0x1 00010000:00010000:1.0:1787782855.123937:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1787782855.123943:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782855.123955:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b6375ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53cc expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.124010:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b6375ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53cc expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.124027:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7400, rc 0) 00000100:00100000:1.0:1787782855.124133:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108258780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904551040:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 313us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782855.124140:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:1.0:1787782855.127411:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782855.127614:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904551296 00000100:00100000:0.0:1787782855.127623:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904551296 00000100:00100000:0.0:1787782855.127686:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:0.0:1787782855.127696:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+58:10455:x1874625904551296:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787782855.128362:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+58:10455:x1874625904551296:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 663us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782855.128372:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:1.0:1787782855.137202:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782855.137316:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904551424 00000100:00100000:3.0:1787782855.137325:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904551424 00000100:00100000:3.0:1787782855.137389:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:3.0:1787782855.137399:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:10455:x1874625904551424:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787782855.137417:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782855.137436:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b6375f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e53d3 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.137467:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b6375ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53cc expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.137478:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782855.137492:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782855.137499:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b6375f6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53d3 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.137646:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b6375ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53cc expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.137663:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b6375ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53cc expref: 7 pid: 6696 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782855.137678:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310825a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874625922403328:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787782855.137771:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787782855.141715:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310825a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874625922403328:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787782855.141762:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b6375f6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53d3 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.141791:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1e00, rc 0) 00000100:00100000:3.0:1787782855.143111:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:10455:x1874625904551424:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 5681us (5886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782855.143125:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:1.0:1787782855.143405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782855.144436:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904551552 00000100:00100000:3.0:1787782855.144446:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904551552 00010000:00010000:3.0:1787782855.144489:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b6375ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53cc expref: 7 pid: 6696 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782855.144558:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:3.0:1787782855.144577:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102e11850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2350:x1874625904551552:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782855.144594:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782855.144620:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b6375ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53cc expref: 7 pid: 6696 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.144635:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b6375ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53cc expref: 7 pid: 6696 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.144660:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b6375ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53cc expref: 7 pid: 6696 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.144675:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782855.144680:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782855.144687:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b6375f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53d3 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.144698:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b6375f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53d3 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.144736:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b6375f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53d3 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782855.144751:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310825a580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5836:1874625922403456:192.168.202.15@tcp:105: 00000100:00100000:3.0:1787782855.144826:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787782855.148927:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310825a580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5836:1874625922403456:192.168.202.15@tcp:105: 00010000:00010000:3.0:1787782855.148974:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782855.149061:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102e11850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904551552:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 4484us (5656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782855.149076:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:1.0:1787782855.153932:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782855.154057:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904551680 00000100:00100000:0.0:1787782855.154068:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904551680 00002000:00100000:0.0:1787782855.154158:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8c313cc05680 x1874625904551680/t0(0) o4->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:246/0 lens 504/0 e 0 to 0 dl 1787782866 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787782855.154170:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c313cc05680 with x1874625904551680 ext(0->8) 00002000:00010000:0.0:1787782855.154175:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c313cc05680 00000100:00100000:0.0:1787782855.154201:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:0.0:1787782855.154210:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904551680:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787782855.154878:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2349:x1874625904551680:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 Request processed in 667us (954us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787782855.154888:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00002000:00100000:0.0:1787782855.154896:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8c313cc05680 x1874625904551680/t4294967302(0) o4->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:246/0 lens 504/448 e 0 to 0 dl 1787782866 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787782855.154910:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c313cc05680 with x1874625904551680 ext(0->8) 00002000:00010000:0.0:1787782855.154913:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c313cc05680 00000100:00100000:1.0:1787782855.161439:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782855.161540:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904551808 00000100:00100000:3.0:1787782855.161551:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904551808 00000100:00100000:3.0:1787782855.161614:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:3.0:1787782855.161625:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+58:10455:x1874625904551808:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787782855.183677:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782855.183713:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782855.183738:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782855.183764:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904552064 00000100:00100000:3.0:1787782855.183773:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904552064 00000100:00100000:3.0:1787782855.183834:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:3.0:1787782855.183845:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2351:x1874625904552064:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782855.184251:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2351:x1874625904552064:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 407us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782855.184260:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:3.0:1787782855.184286:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904551936 00000100:00100000:3.0:1787782855.184289:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904551936 00000100:00100000:3.0:1787782855.184313:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 293 00000100:00100000:3.0:1787782855.184320:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2351:x1874625904551936:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782855.184346:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2351:x1874625904551936:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 27us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782855.184352:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 293 00000100:00080000:3.0:1787782855.184392:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787782855.185794:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904552192 00000100:00100000:3.0:1787782855.185807:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904552192 00000100:00100000:3.0:1787782855.185856:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 145 00000100:00100000:3.0:1787782855.185865:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108259e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2351:x1874625904552192:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782855.187266:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108259e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2351:x1874625904552192:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 1395us (3520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782855.187279:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 145 00000100:00080000:3.0:1787782855.187315:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782855.232498:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+58:10455:x1874625904551808:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 Request processed in 70862us (71060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782855.232514:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 80 00000001:00080000:1.0:1787782855.232934:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1787782855.232942:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:1.0:1787782855.232968:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1787782855.232983:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787782855.233027:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c312f10b900 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787782855.233031:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c3108394f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c312f10b0c0 00000020:00080000:1.0:1787782855.233034:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c3108394400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c3108253400 00000001:00080000:1.0:1787782855.233072:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1787782855.233221:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1787782855.233333:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787782855.233352:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922403584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787782855.233410:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782855.233564:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922403584 00000100:00100000:1.0:1787782855.233573:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922403584 00000100:00100000:1.0:1787782855.233634:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787782855.233643:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625922403584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787782855.233666:0:6967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1787782855.233699:0:6967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8f66c3, atime: 0x6a8f66c4, ctime: 0x6a8f66c3, blocks: 0x1 00010000:00010000:1.0:1787782855.233706:0:6967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b6375fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.233723:0:6967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1787782855.233728:0:6967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782855.233734:0:6967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b6375fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.233752:0:6967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b6375fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.233762:0:6967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b6375fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.233769:0:6967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b6375fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.233786:0:6967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1787782855.234531:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787782855.235039:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31347f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922403712:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787782855.235133:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782855.236288:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3305:x1874625922403584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2642us (2874us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787782855.236299:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787782855.236327:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922403712 00000100:00100000:1.0:1787782855.236334:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922403712 00000100:00100000:1.0:1787782855.236371:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787782855.236378:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922403712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787782855.236662:0:6967:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787782855.236666:0:6967:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787782855 00002000:00010000:1.0:1787782855.236668:0:6967:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787782855.236670:0:6967:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787782855 -> 1787782855 00002000:00010000:1.0:1787782855.236673:0:6967:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787782855.236706:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874625922403712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 327us (1573us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787782855.236713:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1787782855.236733:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782855.236741:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b6375fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.236752:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6600 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782855.236757:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b6375fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.236767:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b6375fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.236785:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b6375fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.236792:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b6375fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.236817:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782855.236819:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782855.236821:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787782855.236852:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c313cc07840/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787782855.236859:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922403584:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1787782855.236877:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787782855.236900:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c31347f4b40/2, rc 0, transno 4294967303 00000100:00100000:1.0:1787782855.236904:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31347f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922403712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787782855.237201:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782855.237227:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904552320 00000100:00100000:3.0:1787782855.237231:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904552320 00000100:00100000:3.0:1787782855.237257:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:3.0:1787782855.237264:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c7ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2351:x1874625904552320:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787782855.264120:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c7ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2351:x1874625904552320:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 Request processed in 26815us (26880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782855.264138:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 30 00000001:00080000:1.0:1787782855.265132:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1787782855.265147:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1787782855.266308:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782855.266382:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904552576 00000100:00100000:0.0:1787782855.266390:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904552576 00000100:00100000:0.0:1787782855.266434:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:0.0:1787782855.266441:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108258780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+13:10455:x1874625904552576:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787782855.266489:0:6719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782855.266517:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6375e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53c5 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.266534:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c310823c000) 00010000:00010000:0.0:1787782855.266539:0:6719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787782855.266571:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637604 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.266585:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.266595:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787782855.266781:0:6719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb0f0a91 reply state 000000003ccefced transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782855.266788:0:6719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787782855.267022:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108258780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+14:10455:x1874625904552576:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 580us (718us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787782855.267028:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 81 00010000:00010000:3.0:1787782855.268315:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.268326:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637604 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.268331:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.268335:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782855.268347:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.268353:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637604 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.268364:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c310823c000) 00010000:00010000:3.0:1787782855.268365:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782855.268369:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637604 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.268373:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637604 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782855.269457:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782855.269530:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904552704 00000100:00100000:1.0:1787782855.269539:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904552704 00000100:00100000:1.0:1787782855.269591:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:1.0:1787782855.269602:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904552704:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787782855.270018:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787782855.270022:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787782855 -> 1787782853 00002000:00010000:1.0:1787782855.270024:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787782852 00002000:00010000:1.0:1787782855.270026:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787782855 -> 1787782853 00002000:00010000:1.0:1787782855.270028:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787782855.270129:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2349:x1874625904552704:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 527us (674us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787782855.270137:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:0.0:1787782855.271594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782855.271649:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904552960 00000100:00100000:3.0:1787782855.271657:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904552960 00000100:00100000:3.0:1787782855.271700:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:3.0:1787782855.271710:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+13:10455:x1874625904552960:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787782855.271774:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63760b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.271787:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6375c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53b7 expref: 13 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.271794:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63760b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.271818:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6375c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53b7 expref: 13 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.271845:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6375c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53b7 expref: 13 pid: 6719 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782855.271855:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310825a580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922403840:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787782855.271932:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782855.273655:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782855.273710:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904553088 00000100:00100000:1.0:1787782855.273718:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904553088 00000100:00100000:0.0:1787782855.273731:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310825a580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922403840:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782855.273752:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6375c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53b7 expref: 14 pid: 6719 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.273754:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63760b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782855.273802:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:1.0:1787782855.273812:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+14:2350:x1874625904553088:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782855.273826:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782855.273833:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6375c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53b7 expref: 14 pid: 6719 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.273842:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6375c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53b7 expref: 14 pid: 6719 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.273858:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6375c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53b7 expref: 14 pid: 6719 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.273869:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c310823c000) 00010000:00010000:1.0:1787782855.273872:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63760b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.273879:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63760b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.273884:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63760b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.273903:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787782855.273929:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63760b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.273936:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63760b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782855.273959:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+13:2350:x1874625904553088:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 149us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782855.273966:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00010000:00010000:0.0:1787782855.274734:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63760b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.274745:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63760b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.274749:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63760b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.274754:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782855.274757:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63760b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.274762:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63760b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.274770:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c310823c000) 00010000:00010000:0.0:1787782855.274771:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787782855.274774:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63760b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.274788:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b63760b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782855.274833:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+12:10455:x1874625904552960:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 Request processed in 3124us (3245us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787782855.274841:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:3.0:1787782855.276320:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782855.276360:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904553216 00000100:00100000:1.0:1787782855.276379:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904553216 00000100:00100000:1.0:1787782855.276431:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:1.0:1787782855.276441:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2350:x1874625904553216:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787782855.276478:0:6967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ac6cd0e/0x6d98ed19b637612 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.276492:0:6967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b6375f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53d3 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.276497:0:6967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782855.276501:0:6967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787782855.276504:0:6967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ac6cd0e/0x6d98ed19b637612 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.276538:0:6967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b6375f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53d3 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.276549:0:6967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b6375f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53d3 expref: 7 pid: 6698 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782855.276560:0:6967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc061c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6967:1874625922403968:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782855.276619:0:6967:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31342f8840 going to sleep for 11 seconds 00000100:00100000:1.0:1787782855.278782:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782855.278833:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904553344 00000100:00100000:0.0:1787782855.278843:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904553344 00000100:00100000:2.0:1787782855.278859:0:6967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc061c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6967:1874625922403968:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787782855.278890:0:6967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006ac6cd0e/0x6d98ed19b637612 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.278891:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b6375f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53d3 expref: 8 pid: 6698 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782855.278939:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:0.0:1787782855.278948:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2349:x1874625904553344:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782855.278963:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782855.278988:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b6375f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53d3 expref: 8 pid: 6698 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.279002:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b6375f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53d3 expref: 8 pid: 6698 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.279025:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b6375f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53d3 expref: 8 pid: 6698 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.279043:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787782855.279063:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787782855.279069:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006ac6cd0e/0x6d98ed19b637612 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.279120:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ac6cd0e/0x6d98ed19b637612 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.279148:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782855.279193:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2349:x1874625904553344:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 245us (421us total) trans 0 rc 0/0 00010000:00010000:2.0:1787782855.279195:0:6967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006ac6cd0e/0x6d98ed19b637612 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782855.279205:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 44 00010000:00010000:2.0:1787782855.279211:0:6967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ac6cd0e/0x6d98ed19b637612 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782855.279239:0:6967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006ac6cd0e/0x6d98ed19b637612 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782855.279254:0:6967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ac6cd0e/0x6d98ed19b637612 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782855.279262:0:6967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ac6cd0e/0x6d98ed19b637612 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782855.279269:0:6967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6600 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787782855.279274:0:6967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ac6cd0e/0x6d98ed19b637612 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782855.279284:0:6967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ac6cd0e/0x6d98ed19b637612 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782855.279299:0:6967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ac6cd0e/0x6d98ed19b637612 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782855.279308:0:6967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ac6cd0e/0x6d98ed19b637612 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782855.279366:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904553216:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 Request processed in 2927us (3051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782855.279375:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:1.0:1787782855.281000:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782855.281092:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904553600 00000100:00100000:3.0:1787782855.281121:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904553600 00000100:00100000:3.0:1787782855.281164:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 83 00000100:00100000:3.0:1787782855.281171:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+12:10455:x1874625904553600:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787782855.281231:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637619 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.281244:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637619 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.281252:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637619 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.281456:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637620 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.281464:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6375d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53be expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.281469:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637620 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.281500:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6375d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53be expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.281513:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6375d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53be expref: 13 pid: 5851 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782855.281527:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31340bd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922404096:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787782855.281609:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787782855.283678:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782855.283883:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31340bd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922404096:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787782855.283911:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637620 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782855.283931:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904553728 00000100:00100000:1.0:1787782855.283938:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904553728 00010000:00010000:1.0:1787782855.283974:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6375d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53be expref: 14 pid: 5851 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782855.284075:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:1.0:1787782855.284085:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340be580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+14:2350:x1874625904553728:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782855.284169:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782855.284178:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6375d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53be expref: 14 pid: 5851 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.284191:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6375d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53be expref: 14 pid: 5851 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.284211:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6375d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53be expref: 14 pid: 5851 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.284228:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c310823c000) 00010000:00010000:1.0:1787782855.284233:0:7637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637620 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.284239:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637620 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.284245:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637620 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.284265:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787782855.284280:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637620 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.284287:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637620 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782855.284338:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340be580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+13:2350:x1874625904553728:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 254us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782855.284344:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00000001:00080000:0.0:1787782855.284496:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1787782855.284806:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787782855.284853:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1787782855.285016:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310827cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5853:1874625922404224:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787782855.285071:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782855.285115:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107d8e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787782855.285148:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922404224 00000100:00100000:2.0:1787782855.285156:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922404224 00000100:00100000:2.0:1787782855.285192:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782855.285202:0:5856:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787782855.285208:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1874625922404224:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787782855.285209:0:5856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1787782855.285297:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1874625922404224:12345-0@lo:1000:mdt00_002.0 Request processed in 92us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782855.285304:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782855.285365:0:5853:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1787782855.285371:0:5853:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c31347f4b40, transno 4294967303 00000100:00100000:0.0:1787782855.285557:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310827cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5853:1874625922404224:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787782855.285997:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1787782855.286044:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310827cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5853:1874625922404352:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787782855.286092:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782855.286145:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922404352 00000100:00100000:0.0:1787782855.286147:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782855.286149:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922404352 00000100:00100000:2.0:1787782855.286170:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787782855.286174:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1874625922404352:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787782855.286356:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5853:x1874625922404352:12345-0@lo:1000:mdt00_002.0 Request processed in 180us (264us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787782855.286364:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787782855.286393:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310827cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5853:1874625922404352:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787782855.286424:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637620 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286434:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637620 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286441:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637620 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286447:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782855.286452:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637620 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286460:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637620 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286475:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c310823c000) 00010000:00010000:0.0:1787782855.286478:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787782855.286483:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637620 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286490:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637620 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286525:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b63754e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286538:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b63754e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286544:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b63754e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286549:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782855.286552:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b63754e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286560:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b63754e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286568:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3104d6ed00) 00010000:00010000:0.0:1787782855.286570:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787782855.286573:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b63754e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286579:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b63754e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286600:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637627 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286623:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63756a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53a2 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286632:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637627 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286656:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63756a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53a2 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.286676:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63756a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53a2 expref: 16 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782855.286686:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310827c780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922404480:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787782855.286755:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782855.290789:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782855.290837:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904553856 00000100:00100000:3.0:1787782855.290847:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904553856 00010000:00010000:3.0:1787782855.290926:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63756a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53a2 expref: 17 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782855.291002:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310827c780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922404480:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787782855.291027:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637627 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782855.291121:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:3.0:1787782855.291132:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+17:2349:x1874625904553856:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782855.291149:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782855.291157:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63756a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53a2 expref: 17 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.291169:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63756a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53a2 expref: 17 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.291191:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b63756a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53a2 expref: 17 pid: 5853 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.291225:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3104d6ed00) 00010000:00010000:3.0:1787782855.291230:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637627 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.291240:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.291249:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637627 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782855.291277:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782855.291336:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+16:2349:x1874625904553856:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 206us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782855.291343:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 46 00010000:00010000:0.0:1787782855.291450:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.291459:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.291471:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.291478:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637627 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.291485:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637627 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.291491:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782855.291495:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637627 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.291503:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637627 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.291522:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3104d6ed00) 00010000:00010000:0.0:1787782855.291526:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782855.291530:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637627 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.291537:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637627 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.291549:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637619 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.291555:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637619 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.291570:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637619 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.291576:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782855.291579:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637619 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.291584:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637619 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.291592:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3104d6ed00) 00010000:00010000:0.0:1787782855.291594:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787782855.291597:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637619 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.291602:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637619 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782855.291833:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+15:10455:x1874625904553600:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 10661us (10840us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787782855.291840:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 83 00000020:00080000:0.0:1787782855.291843:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787782855.292020:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787782855.292029:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787782855.292066:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787782855.292073:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787782855.293569:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782855.293630:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904554112 00000100:00100000:0.0:1787782855.293636:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904554112 00000100:00100000:0.0:1787782855.293675:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:0.0:1787782855.293682:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+15:10455:x1874625904554112:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787782855.294430:0:11490:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787782855.294506:0:11490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1787782855.294553:0:11490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b63762e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.294571:0:11490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b63762e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.294583:0:11490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b63762e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.294593:0:11490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b63762e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.294601:0:11490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b63762e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.294607:0:11490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b63762e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782855.294620:0:11490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787782855.294704:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+17:10455:x1874625904554112:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 1020us (1137us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1787782855.294713:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000020:00080000:0.0:1787782855.294718:0:11490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787782855.294782:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782855.294789:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b63762e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.294796:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254000 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782855.294800:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b63762e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.294808:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b63762e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.294821:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c310823c000) 00010000:00010000:1.0:1787782855.294824:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787782855.294828:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b63762e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.294832:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b63762e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782855.294844:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782855.294845:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782855.294846:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782856.033468:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787782857.001116:0:12063:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787782857.001127:0:12063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787782857.001168:0:12063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787782857.001175:0:12063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787782857.065986:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782857.183694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782857.183836:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904554368 00000100:00100000:0.0:1787782857.183850:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904554368 00000100:00100000:0.0:1787782857.183946:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:0.0:1787782857.183957:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310826ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+17:10474:x1874625904554368:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787782857.184003:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782857.184040:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637635 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e53da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.184422:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b63763c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.184442:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b63763c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.184456:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b63763c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782857.184471:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787782857.184676:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637635 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53da expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.184696:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b63763c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53da expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.184718:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:0.0:1787782857.184722:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787782857.184726:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254000, rc 0) 00000100:00100000:0.0:1787782857.184825:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310826ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+19:10474:x1874625904554368:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 869us (1146us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787782857.184833:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00080000:3.0:1787782857.185356:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782857.193373:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782857.195321:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904554496 00000100:00100000:2.0:1787782857.195339:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904554496 00000100:00100000:2.0:1787782857.197047:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:2.0:1787782857.197073:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+19:10474:x1874625904554496:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:2.0:1787782857.197202:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b63764a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197225:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b63764a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197239:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b63764a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197269:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294800/0x6d98ed19b637651 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197277:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294800/0x6d98ed19b637651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197285:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294800/0x6d98ed19b637651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197676:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197686:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197694:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787782857.197747:0:6719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197762:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b63764a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197768:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b63764a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197776:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b63764a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197782:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f295c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782857.197787:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b63764a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197804:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b63764a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197821:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:2.0:1787782857.197825:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782857.197831:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b63764a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197838:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b63764a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197857:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294800/0x6d98ed19b637651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197862:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294800/0x6d98ed19b637651 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197868:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294800/0x6d98ed19b637651 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197873:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f294800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782857.197876:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294800/0x6d98ed19b637651 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197882:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294800/0x6d98ed19b637651 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197891:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3108738c00) 00010000:00010000:2.0:1787782857.197894:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782857.197897:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294800/0x6d98ed19b637651 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197914:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294800/0x6d98ed19b637651 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197932:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197938:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637658 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197944:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197950:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f294400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782857.197953:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197959:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637658 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197968:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3108738300) 00010000:00010000:2.0:1787782857.197970:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782857.197973:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637658 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.197979:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637658 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782857.198141:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+19:10474:x1874625904554496:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 1075us (4780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782857.198153:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:1.0:1787782857.268442:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782857.277370:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904554752 00000100:00100000:0.0:1787782857.277392:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904554752 00000100:00100000:0.0:1787782857.277607:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:0.0:1787782857.277619:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+19:10477:x1874625904554752:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787782857.277648:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782857.277675:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b63765f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e53e1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.277770:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637666 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.277787:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637666 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.277801:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637666 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.277817:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63766d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.277825:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63766d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.277842:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63766d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278277:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637674 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278288:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278297:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782857.278308:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787782857.278423:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637666 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278432:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637666 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278440:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637666 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278447:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782857.278452:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637666 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278461:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637666 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278475:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:0.0:1787782857.278479:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782857.278490:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637666 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278497:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637666 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278510:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63766d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278516:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63766d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278523:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63766d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278528:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782857.278531:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63766d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278537:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63766d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278545:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c310823cf00) 00010000:00010000:0.0:1787782857.278547:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782857.278550:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63766d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278556:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b63766d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278604:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b63765f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e1 expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278633:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e1 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.278641:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c310823c600) 00010000:00010000:0.0:1787782857.278644:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787782857.278646:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254200, rc 0) 00000100:00100000:0.0:1787782857.278742:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+21:10477:x1874625904554752:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1124us (10313us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787782857.278751:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:1.0:1787782857.305761:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782857.306560:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904554880 00000100:00100000:2.0:1787782857.306584:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904554880 00000100:00100000:2.0:1787782857.306661:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:2.0:1787782857.306674:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+21:10477:x1874625904554880:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:2.0:1787782857.306763:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637682 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.306785:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.306798:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.306831:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.306838:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637682 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.306845:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637682 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.306852:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f294400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782857.306857:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637682 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.306865:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637682 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.306879:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c310823c600) 00010000:00010000:2.0:1787782857.306883:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787782857.306888:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637682 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.306911:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b637682 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782857.307074:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+21:10477:x1874625904554880:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 401us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782857.307084:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:3.0:1787782857.310924:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782857.311059:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904555136 00000100:00100000:0.0:1787782857.311072:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904555136 00000100:00100000:0.0:1787782857.311246:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:0.0:1787782857.311504:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310619f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+21:10477:x1874625904555136:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787782857.313004:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310619f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+22:10477:x1874625904555136:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 1735us (2085us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787782857.313021:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000001:00080000:3.0:1787782857.365892:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:3.0:1787782857.365917:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:3.0:1787782857.365926:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1787782857.369667:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782857.369786:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904555392 00000100:00100000:0.0:1787782857.369799:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904555392 00000100:00100000:0.0:1787782857.369919:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:0.0:1787782857.369930:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+22:9997:x1874625904555392:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787782857.369970:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782857.369996:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637689 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e53e8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.370174:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637690 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.370207:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637674 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e1 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.370218:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637690 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.370276:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e1 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.370292:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637674 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e1 expref: 23 pid: 5851 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782857.370308:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310827c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1874625922404608:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787782857.370421:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782857.374074:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310827c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1874625922404608:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787782857.374163:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637690 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782857.374700:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782857.375506:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904555520 00000100:00100000:1.0:1787782857.375520:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904555520 00010000:00010000:1.0:1787782857.375588:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637674 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e1 expref: 24 pid: 5851 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782857.375717:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:1.0:1787782857.375729:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+24:2350:x1874625904555520:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782857.375752:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782857.375761:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637674 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e1 expref: 24 pid: 5851 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.375777:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e1 expref: 24 pid: 5851 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.375809:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637674 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e1 expref: 24 pid: 5851 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.375831:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c310823c600) 00010000:00010000:1.0:1787782857.375837:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637690 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.375846:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637690 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.375854:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637690 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.375905:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782857.375989:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+23:2350:x1874625904555520:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 261us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782857.375998:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00010000:00010000:2.0:1787782857.376076:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637690 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.376086:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637690 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782857.376141:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787782857.377024:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637689 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e8 expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.377059:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637690 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e8 expref: 23 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.377069:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c310823c600) 00010000:00010000:2.0:1787782857.377072:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787782857.377075:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255800, rc 0) 00000100:00100000:2.0:1787782857.377353:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+23:9997:x1874625904555392:12345-192.168.202.15@tcp:101:bash.0 Request processed in 7423us (7699us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787782857.377364:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:3.0:1787782857.384884:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782857.385447:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904555776 00000100:00100000:0.0:1787782857.385463:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904555776 00000100:00100000:0.0:1787782857.385544:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 89 00000100:00100000:0.0:1787782857.385557:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3112d79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+23:9997:x1874625904555776:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:0.0:1787782857.385920:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b63769e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.385944:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b63769e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.386847:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b63769e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787782857.387520:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787782857.387587:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af7ac454 reply state 00000000171a12b1 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b63769e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782857.387616:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787782857.387707:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787782857.388056:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3112d79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+27:9997:x1874625904555776:12345-192.168.202.15@tcp:36:bash.0 Request processed in 2496us (3183us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787782857.388067:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 89 00000020:00080000:2.0:1787782857.388075:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787782857.392159:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b63769e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.392183:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b63769e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.392192:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b63769e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.392199:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782857.392204:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b63769e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.392213:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b63769e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.392245:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c310823c600) 00010000:00010000:0.0:1787782857.392248:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782857.392254:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b63769e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.392260:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b63769e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782857.397492:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782857.397614:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904555904 00000100:00100000:2.0:1787782857.397628:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904555904 00000100:00100000:2.0:1787782857.397710:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 90 00000100:00100000:2.0:1787782857.397720:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+26:9997:x1874625904555904:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787782857.397754:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782857.397783:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b6376a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e53ef expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.397862:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b6376a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53ef expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.397878:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b6376a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53ef expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.398048:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c310823c600) 00010000:00010000:2.0:1787782857.398053:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787782857.398059:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312f294400, rc 0) 00000100:00100000:2.0:1787782857.398167:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+27:9997:x1874625904555904:12345-192.168.202.15@tcp:101:bash.0 Request processed in 447us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782857.398175:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 90 00000100:00100000:3.0:1787782857.403663:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782857.404555:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904556032 00000100:00100000:2.0:1787782857.404593:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904556032 00000100:00100000:2.0:1787782857.404803:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:2.0:1787782857.404817:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:9997:x1874625904556032:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787782857.404843:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782857.404873:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7a7c03d/0x6d98ed19b6376ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e53f6 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787782857.404923:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f66c5, atime: 0x6a8f66c4, ctime: 0x6a8f66c5, blocks: 0xb 00010000:00010000:2.0:1787782857.404953:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1787782857.404968:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782857.404979:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a7c03d/0x6d98ed19b6376ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53f6 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.405004:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7a7c03d/0x6d98ed19b6376ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53f6 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.405019:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312f294800, rc 0) 00000100:00100000:2.0:1787782857.405183:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:9997:x1874625904556032:12345-192.168.202.15@tcp:101:bash.0 Request processed in 369us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782857.405192:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00080000:3.0:1787782857.405268:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787782857.407795:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782857.407984:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904556160 00000100:00100000:2.0:1787782857.407996:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904556160 00002000:00010000:2.0:1787782857.408069:0:6702:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787782857.408075:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c312eeda1c0 with x1874625904556160 ext(0->18446744073709551615) 00002000:00010000:2.0:1787782857.408090:0:6702:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c312eeda1c0. 00000100:00100000:2.0:1787782857.408161:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:2.0:1787782857.408173:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eeda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2349:x1874625904556160:12345-192.168.202.15@tcp:10:bash.0 00002000:00010000:2.0:1787782857.408663:0:6702:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787782857.408669:0:6702:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787782853 -> 1787782857 00002000:00010000:2.0:1787782857.408672:0:6702:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787782852 -> 1787782852 00002000:00010000:2.0:1787782857.408674:0:6702:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787782853 -> 1787782857 00002000:00010000:2.0:1787782857.408676:0:6702:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787782857.408820:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eeda1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2349:x1874625904556160:12345-192.168.202.15@tcp:10:bash.0 Request processed in 647us (1037us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787782857.408830:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00002000:00010000:2.0:1787782857.408834:0:6702:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787782857.408837:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c312eeda1c0 with x1874625904556160 ext(0->18446744073709551615) 00002000:00010000:2.0:1787782857.408843:0:6702:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c312eeda1c0. 00000100:00100000:0.0:1787782857.524350:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782857.525267:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904556288 00000100:00100000:2.0:1787782857.525279:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904556288 00000100:00100000:2.0:1787782857.525351:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:2.0:1787782857.525362:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+27:10491:x1874625904556288:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:2.0:1787782857.525454:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.525471:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.525482:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.525496:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.525504:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.525524:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.530366:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b6376c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.530877:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b6376c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.530891:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b6376c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787782857.530942:0:6719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b6376c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.530955:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.530973:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.530979:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.530985:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f295c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782857.530989:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.530996:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.531009:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:2.0:1787782857.531035:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782857.531041:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.531048:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.531066:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.531073:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.531079:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.531085:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f294000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782857.531087:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.532068:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.532088:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3108738900) 00010000:00010000:2.0:1787782857.532090:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782857.532875:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.532887:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.532916:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b6376c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.532947:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b6376c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.532954:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b6376c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.533135:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f294200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782857.533323:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b6376c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.533335:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b6376c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.533346:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c310823c600) 00010000:00010000:2.0:1787782857.533349:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782857.533353:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b6376c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.533359:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b6376c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782857.534688:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+27:10491:x1874625904556288:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 9319us (10340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782857.534702:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:1.0:1787782857.581903:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782857.582009:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904556544 00000100:00100000:2.0:1787782857.582019:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904556544 00000100:00100000:2.0:1787782857.582149:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:2.0:1787782857.582161:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+27:10494:x1874625904556544:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787782857.582183:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782857.582214:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b6376c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e53fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582292:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582306:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582317:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582331:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582337:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582344:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582661:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6376dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582671:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6376dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582679:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6376dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782857.582690:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787782857.582789:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582806:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582813:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582819:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f294000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782857.582824:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582831:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582845:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:2.0:1787782857.582848:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782857.582852:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582859:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b6376cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582873:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582880:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582886:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582891:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f295c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782857.582902:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582908:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582915:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3108738900) 00010000:00010000:2.0:1787782857.582918:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782857.582920:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582927:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582968:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b6376c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53fd expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582982:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6376dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53fd expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.582990:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c310823c600) 00010000:00010000:2.0:1787782857.582992:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787782857.582994:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312f295600, rc 0) 00000100:00100000:2.0:1787782857.583082:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+29:10494:x1874625904556544:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 923us (1189us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787782857.583090:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:3.0:1787782857.594088:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782857.594309:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904556672 00000100:00100000:0.0:1787782857.594319:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904556672 00000100:00100000:0.0:1787782857.594394:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 93 00000100:00100000:0.0:1787782857.594406:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eed8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+29:10494:x1874625904556672:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:0.0:1787782857.594474:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6376eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.594492:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637690 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e8 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.594502:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6376eb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.594536:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637690 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e8 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.594550:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637690 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e8 expref: 29 pid: 5851 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782857.594564:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310825bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922404736:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787782857.594660:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787782857.604614:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782857.604806:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310825bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922404736:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787782857.604834:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6376eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782857.606748:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904556928 00000100:00100000:2.0:1787782857.606761:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904556928 00000100:00100000:2.0:1787782857.606834:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:2.0:1787782857.606846:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eedb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+30:5588:x1874625904556928:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787782857.607468:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eedb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+31:5588:x1874625904556928:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 622us (2865us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787782857.607477:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:1.0:1787782857.610256:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782857.610412:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904557056 00000100:00100000:0.0:1787782857.610421:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904557056 00010000:00010000:0.0:1787782857.610460:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637690 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e8 expref: 31 pid: 5851 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782857.610505:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:0.0:1787782857.610529:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc05e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+31:2349:x1874625904557056:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782857.610544:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782857.610552:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637690 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e8 expref: 31 pid: 5851 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.610567:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637690 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e8 expref: 31 pid: 5851 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.610589:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637690 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53e8 expref: 31 pid: 5851 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.610606:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c310823c600) 00010000:00010000:0.0:1787782857.610611:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6376eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.610621:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6376eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.610629:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6376eb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.610662:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782857.610717:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc05e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+30:2349:x1874625904557056:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 190us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782857.610725:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 48 00010000:00010000:2.0:1787782857.611326:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6376eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.611336:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6376eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.611363:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6376eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.611371:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6376eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.611377:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6376eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.611382:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782857.611387:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6376eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.611395:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6376eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.611405:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c310823c600) 00010000:00010000:2.0:1787782857.611408:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787782857.611412:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6376eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.611417:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b6376eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782857.611482:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eed8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+29:10494:x1874625904556672:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 17078us (17403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782857.611491:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 93 00000100:00100000:1.0:1787782857.615492:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782857.615608:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904557312 00000100:00100000:2.0:1787782857.615617:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904557312 00000100:00100000:2.0:1787782857.615669:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:2.0:1787782857.615679:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+29:10494:x1874625904557312:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787782857.615881:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+30:10494:x1874625904557312:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 203us (398us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787782857.615889:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:0.0:1787782857.782793:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782857.784074:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904557568 00000100:00100000:2.0:1787782857.784085:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904557568 00000100:00100000:2.0:1787782857.784374:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 94 00000100:00100000:2.0:1787782857.784385:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+30:10505:x1874625904557568:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:2.0:1787782857.784413:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782857.784433:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b6376f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5404 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.784505:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.784519:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.784532:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.784566:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637700 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.784575:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.784582:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.785523:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b637707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.785534:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b637707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.785543:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b637707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782857.785554:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787782857.786391:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.786402:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.786409:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.786416:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f295c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782857.786421:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.786440:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.786455:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:2.0:1787782857.786458:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782857.786463:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.786470:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295c00/0x6d98ed19b6376f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.786487:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.786494:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637700 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.786500:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.786506:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f294000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782857.786508:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.786514:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637700 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.786521:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3108738900) 00010000:00010000:2.0:1787782857.786524:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782857.786527:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637700 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.786543:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294000/0x6d98ed19b637700 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.787328:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294200/0x6d98ed19b6376f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5404 expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.787350:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b637707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5404 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.787359:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c310823c600) 00010000:00010000:2.0:1787782857.787361:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787782857.787364:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204c00, rc 0) 00000100:00100000:2.0:1787782857.787439:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+32:10505:x1874625904557568:12345-192.168.202.15@tcp:101:cat.0 Request processed in 3055us (4657us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787782857.787448:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 94 00000100:00100000:1.0:1787782857.797396:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782857.797525:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904557824 00000100:00100000:3.0:1787782857.797535:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904557824 00000100:00100000:3.0:1787782857.797595:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:3.0:1787782857.797605:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+32:10505:x1874625904557824:12345-192.168.202.15@tcp:35:cat.0 00000100:00100000:3.0:1787782857.797855:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+33:10505:x1874625904557824:12345-192.168.202.15@tcp:35:cat.0 Request processed in 251us (468us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787782857.797864:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:1.0:1787782857.829238:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782857.829464:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904558080 00000100:00100000:2.0:1787782857.829475:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904558080 00000100:00100000:2.0:1787782857.829542:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 95 00000100:00100000:2.0:1787782857.829554:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+33:10506:x1874625904558080:12345-192.168.202.15@tcp:36:rm.0 00010000:00010000:2.0:1787782857.829626:0:6719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787782857.829654:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b637707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5404 expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.829682:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295600/0x6d98ed19b6376dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53fd expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.829717:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f294400/0x6d98ed19b6376a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53ef expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.829728:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c310823c600) 00010000:00010000:2.0:1787782857.829739:0:6719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782857.829759:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b637715 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.829773:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b637715 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.829784:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b637715 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.829797:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b63771c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.829804:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b63771c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.829810:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b63771c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.830199:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637723 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.830209:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637723 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.830218:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637723 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787782857.833484:0:6719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1787782857.833498:0:6719:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 342503401647ns, next at 343503398828ns, rc = 0 00010000:00010000:2.0:1787782857.833574:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b63772a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.833806:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b63772a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.833820:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b63772a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.833829:0:6719:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b63772a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.833835:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b63772a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.833840:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b63772a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.833866:0:6719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782857.833891:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637723 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.833897:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637723 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.833902:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637723 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.833907:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782857.833920:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637723 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.834253:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637723 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.834265:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3108738b00) 00010000:00010000:2.0:1787782857.834268:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787782857.834273:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637723 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.834279:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637723 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.834302:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b637715 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.834308:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b637715 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.834314:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b637715 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.834319:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782857.834322:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b637715 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.834327:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b637715 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.834334:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:2.0:1787782857.834336:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782857.834346:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b637715 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782857.834352:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b637715 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787782857.834364:0:6719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000db8aecaa reply state 00000000dd2d29ea transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b63771c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782857.834373:0:6719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787782857.834462:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+32:10506:x1874625904558080:12345-192.168.202.15@tcp:36:rm.0 Request processed in 4907us (5230us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787782857.834471:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 95 00010000:00010000:1.0:1787782857.834968:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782857.834977:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b63772a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.834984:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205600 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782857.834987:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b63772a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.834994:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b63772a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.835003:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c3108738b00) 00010000:00010000:1.0:1787782857.835006:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787782857.835009:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b63772a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.835014:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b63772a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.835046:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782857.835048:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782857.835050:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782857.840823:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b63771c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782857.840848:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b63771c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782857.840856:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b63771c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782857.840863:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782857.840868:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b63771c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782857.840877:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b63771c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782857.840909:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3108738900) 00010000:00010000:3.0:1787782857.840913:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782857.840919:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b63771c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782857.840926:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b63771c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782857.942298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782857.942559:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904558336 00000100:00100000:0.0:1787782857.942573:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904558336 00000100:00100000:0.0:1787782857.942664:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 96 00000100:00100000:0.0:1787782857.942693:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+31:10512:x1874625904558336:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787782857.942726:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782857.942755:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637731 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e540b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.942934:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637738 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.942966:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637738 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.942981:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637738 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.942998:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b63773f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.943005:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b63773f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.943011:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b63773f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787782857.943937:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787782857.949763:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637746 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.949795:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.949811:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.949881:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637738 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.949889:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637738 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.949896:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637738 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.949903:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782857.949908:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637738 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.949916:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637738 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.949930:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:0.0:1787782857.949934:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782857.949940:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637738 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.949947:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637738 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787782857.951552:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8ca6772 reply state 0000000085e7176c transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b63773f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782857.951575:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787782857.951639:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637731 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e540b expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.951683:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e540b expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.951693:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c310823cb00) 00010000:00010000:0.0:1787782857.951696:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787782857.951700:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254400, rc 0) 00000100:00100000:0.0:1787782857.951889:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+34:10512:x1874625904558336:12345-192.168.202.15@tcp:101:bash.0 Request processed in 9196us (9608us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787782857.951900:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 96 00010000:00010000:1.0:1787782857.962883:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b63773f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.962917:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b63773f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.962949:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b63773f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.962956:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782857.962971:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b63773f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.962981:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b63773f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.963003:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c310823cf00) 00010000:00010000:1.0:1787782857.963006:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782857.963014:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b63773f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.963020:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b63773f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782857.968259:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782857.968896:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904558464 00000100:00100000:3.0:1787782857.968911:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904558464 00000100:00100000:3.0:1787782857.969014:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:3.0:1787782857.969035:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2349:x1874625904558464:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787782857.969060:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782857.969088:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637754 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5412 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787782857.969152:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782857.969179:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:3.0:1787782857.969184:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782857.969197:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637754 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5412 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782857.969221:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637754 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5412 expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782857.969315:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0000, rc 0) 00000100:00080000:1.0:1787782857.969590:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787782857.970663:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904558464:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1626us (2406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782857.970676:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:0.0:1787782857.992218:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782857.992397:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904558592 00000100:00100000:1.0:1787782857.992410:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904558592 00000100:00100000:1.0:1787782857.992480:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:1.0:1787782857.992498:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:10512:x1874625904558592:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787782857.992522:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782857.992545:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5419 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.992586:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637754 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5412 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.992615:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782857.992620:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782857.992626:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5419 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.992667:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637754 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5412 expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782857.992683:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637754 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5412 expref: 7 pid: 6696 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782857.992699:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344ef840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874625922404864:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782857.992819:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3104d660c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782857.998748:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782857.998851:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904558720 00000100:00100000:0.0:1787782857.998864:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904558720 00010000:00010000:0.0:1787782857.998923:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637754 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5412 expref: 8 pid: 6696 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782857.998974:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:0.0:1787782857.998985:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102e13450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2350:x1874625904558720:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782857.999007:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782857.999047:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637754 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5412 expref: 8 pid: 6696 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.999063:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637754 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5412 expref: 8 pid: 6696 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.999149:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782857.999167:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782857.999178:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5419 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.999190:0:7637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5419 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782857.999257:0:7637:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5419 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782857.999276:0:7637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fcf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7637:1874625922404992:192.168.202.15@tcp:105: 00000100:00100000:0.0:1787782857.999383:0:7637:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7d80 going to sleep for 11 seconds 00010000:00010000:3.0:1787782857.999871:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637754 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5412 expref: 8 pid: 6696 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782857.999890:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344ef840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874625922404864:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787782857.999928:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5419 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782857.999941:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7a00, rc 0) 00000100:00100000:3.0:1787782857.999994:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+7:10512:x1874625904558592:12345-192.168.202.15@tcp:101:bash.0 Request processed in 7497us (7789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782858.000003:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:2.0:1787782858.010651:0:7637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fcf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7637:1874625922404992:192.168.202.15@tcp:105: 00010000:00010000:2.0:1787782858.010683:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782858.010747:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102e13450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904558720:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 11763us (12012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782858.010760:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:1.0:1787782858.010949:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782858.011082:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904558976 00000100:00100000:2.0:1787782858.011091:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904558976 00000100:00100000:2.0:1787782858.011186:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:2.0:1787782858.011197:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+33:10512:x1874625904558976:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:2.0:1787782858.011627:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+34:10512:x1874625904558976:12345-192.168.202.15@tcp:35:bash.0 Request processed in 430us (678us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787782858.011636:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 25 00010000:00010000:0.0:1787782858.082461:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782858.293164:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782858.293368:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904559104 00000100:00100000:0.0:1787782858.293378:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904559104 00000100:00100000:0.0:1787782858.293443:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00100000:0.0:1787782858.293461:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+34:10528:x1874625904559104:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787782858.293488:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782858.293509:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637762 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5420 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.293588:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637769 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.293604:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.293615:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782858.293706:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787782858.293711:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787782858.293735:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.294064:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637762 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5420 expref: 36 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.294082:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5420 expref: 35 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.294090:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:0.0:1787782858.296122:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787782858.296132:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254e00, rc 0) 00000100:00100000:0.0:1787782858.296223:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+35:10528:x1874625904559104:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 2759us (3064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782858.296232:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00100000:3.0:1787782858.301226:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782858.301311:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904559360 00000100:00100000:2.0:1787782858.301320:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904559360 00000100:00100000:2.0:1787782858.301382:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 98 00000100:00100000:2.0:1787782858.301393:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eed8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+35:10528:x1874625904559360:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787782858.301433:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782858.301465:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637770 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5427 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.301568:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b637777 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.301582:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b637777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.301593:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b637777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782858.301604:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787782858.301727:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637770 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5427 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.302298:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b637777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5427 expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.302308:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c310823cb00) 00010000:00010000:2.0:1787782858.302311:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787782858.302314:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204c00, rc 0) 00000100:00100000:2.0:1787782858.302395:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eed8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+37:10528:x1874625904559360:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1004us (1178us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787782858.302403:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 98 00000100:00100000:3.0:1787782858.336330:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782858.336402:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782858.337170:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904559616 00000100:00100000:2.0:1787782858.337187:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904559616 00000100:00100000:2.0:1787782858.337268:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:2.0:1787782858.337294:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eed9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+37:10528:x1874625904559616:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787782858.337321:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782858.337344:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637785 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e542e expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.337441:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b63778c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.337470:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b63778c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.337481:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b63778c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782858.337493:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787782858.337622:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637785 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e542e expref: 40 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.337643:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b63778c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e542e expref: 39 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.337651:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c310823cb00) 00010000:00010000:2.0:1787782858.337655:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787782858.337658:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204200, rc 0) 00000100:00100000:2.0:1787782858.337730:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eed9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+39:10528:x1874625904559616:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 438us (1417us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787782858.337737:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:0.0:1787782858.339363:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904559744 00000100:00100000:0.0:1787782858.339373:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904559744 00000100:00100000:0.0:1787782858.339429:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:0.0:1787782858.339438:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eed92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+39:2350:x1874625904559744:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782858.339464:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782858.339485:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b637777 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5427 expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.339516:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c310823cb00) 00010000:00010000:0.0:1787782858.339682:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782858.339732:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eed92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+38:2350:x1874625904559744:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 295us (3328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782858.339740:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:2.0:1787782858.340262:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31347f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625922405376:0@lo:400:kworker.0 00000100:00100000:3.0:1787782858.340296:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31347f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922405504:0@lo:400:kworker.0 00000100:00100000:2.0:1787782858.340338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782858.340511:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31347f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625922405248:0@lo:400:kworker.0 00000100:00100000:3.0:1787782858.340554:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782858.340626:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787782858.340635:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31347f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922405120:0@lo:400:kworker.0 00000100:00100000:3.0:1787782858.340669:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782858.340697:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31347f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922405632:0@lo:400:kworker.0 00000100:00100000:3.0:1787782858.340722:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782858.340776:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922405504 00000100:00100000:3.0:1787782858.340783:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922405504 00000100:00100000:3.0:1787782858.340840:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787782858.340851:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f135680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874625922405504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782858.341401:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922405376 00000100:00100000:2.0:1787782858.341409:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922405376 00000100:00100000:1.0:1787782858.341727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782858.342007:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922405120 00000100:00100000:0.0:1787782858.342012:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922405120 00000100:00100000:0.0:1787782858.342058:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787782858.342067:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922405120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782858.342145:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922405120:12345-0@lo:400:kworker.0 Request processed in 79us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782858.342153:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787782858.342217:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31347f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922405120:0@lo:400:kworker.0 00000100:00080000:0.0:1787782858.342252:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787782858.342257:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787782858.345553:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f135680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874625922405504:12345-0@lo:400:kworker.0 Request processed in 4687us (4983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782858.345577:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787782858.345587:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782858.347213:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31347f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922405760:0@lo:400:kworker.0 00000100:00100000:1.0:1787782858.347272:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782858.347328:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922405632 00000100:00100000:2.0:1787782858.347337:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922405632 00000100:00100000:3.0:1787782858.347603:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904559872 00000100:00100000:3.0:1787782858.347614:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904559872 00000100:00100000:3.0:1787782858.347702:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:3.0:1787782858.347713:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904559872:12345-192.168.202.15@tcp:1:lfs.0 00010000:00010000:3.0:1787782858.347773:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b63779a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.347798:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5419 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.347809:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787782858.347814:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787782858.347819:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b63779a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.347863:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5419 expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.347880:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5419 expref: 6 pid: 6697 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782858.347895:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fd680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874625922405888:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787782858.350194:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787782858.350292:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31347f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922405504:0@lo:400:kworker.0 00000100:00080000:3.0:1787782858.350468:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782858.350521:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922405248 00000100:00100000:3.0:1787782858.350529:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922405248 00000100:00100000:3.0:1787782858.350551:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787782858.350562:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625922405376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782858.350698:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625922405376:12345-0@lo:400:kworker.0 Request processed in 137us (10362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782858.350706:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787782858.350729:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787782858.350735:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922405632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782858.350770:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922405632:12345-0@lo:400:kworker.0 Request processed in 36us (10047us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782858.350775:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787782858.350806:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31347f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922405632:0@lo:400:kworker.0 00000100:00100000:3.0:1787782858.350827:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787782858.350833:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625922405248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782858.350862:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625922405248:12345-0@lo:400:kworker.0 Request processed in 31us (9138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782858.350868:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787782858.350930:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31347f52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625922405376:0@lo:400:kworker.0 00000100:00100000:1.0:1787782858.351878:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31347f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625922405248:0@lo:400:kworker.0 00000100:00100000:0.0:1787782858.352285:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922405760 00000100:00100000:0.0:1787782858.352294:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922405760 00000100:00100000:0.0:1787782858.352351:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787782858.352360:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922405760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782858.352435:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922405760:12345-0@lo:400:kworker.0 Request processed in 76us (5162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782858.352444:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1787782858.352662:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787782858.352684:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1787782858.352703:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1787782858.352722:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c313cc07840, transno 4294967301 00000100:00100000:1.0:1787782858.352743:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31347f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922405760:0@lo:400:kworker.0 00000100:00100000:3.0:1787782858.358274:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fd680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6696:1874625922405888:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787782858.358323:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b63779a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782858.358543:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782858.358939:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904560000 00000100:00100000:1.0:1787782858.358958:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904560000 00002000:00100000:1.0:1787782858.359037:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8c31070fcf00 x1874625904560000/t0(0) o4->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:249/0 lens 504/0 e 0 to 0 dl 1787782869 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787782858.359048:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c31070fcf00 with x1874625904560000 ext(0->8) 00010000:00010000:1.0:1787782858.359058:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5419 expref: 7 pid: 6697 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.359075:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5419 expref: 7 pid: 6697 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787782858.359083:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c31070fcf00 00000100:00100000:1.0:1787782858.359161:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:1.0:1787782858.359172:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2349:x1874625904560000:12345-192.168.202.15@tcp:4:lfs.0 00000100:00100000:1.0:1787782858.359858:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2349:x1874625904560000:12345-192.168.202.15@tcp:4:lfs.0 Request processed in 683us (1312us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787782858.359870:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00002000:00100000:1.0:1787782858.359880:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8c31070fcf00 x1874625904560000/t4294967302(0) o4->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:249/0 lens 504/448 e 0 to 0 dl 1787782869 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787782858.359890:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c31070fcf00 with x1874625904560000 ext(0->8) 00010000:00010000:1.0:1787782858.359898:0:6703:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5419 expref: 9 pid: 6697 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.359926:0:6703:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5419 expref: 9 pid: 6697 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787782858.359934:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c31070fcf00 00000100:00100000:1.0:1787782858.367601:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782858.367698:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904560128 00000100:00100000:3.0:1787782858.367711:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904560128 00010000:00010000:3.0:1787782858.367767:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5419 expref: 9 pid: 6697 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782858.367849:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:3.0:1787782858.367860:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2349:x1874625904560128:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782858.367888:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787782858.367912:0:5835:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787782858.367915:0:5835:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787782858 00002000:00010000:3.0:1787782858.367919:0:5835:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787782858 00002000:00010000:3.0:1787782858.367921:0:5835:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787782858 00010000:00010000:3.0:1787782858.367927:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5419 expref: 9 pid: 6697 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.367943:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5419 expref: 9 pid: 6697 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.367981:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031d04810/0x6d98ed19b63775b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5419 expref: 9 pid: 6697 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.368004:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787782858.368009:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787782858.368016:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b63779a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.368036:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b63779a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.368073:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782858.368191:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ec780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2349:x1874625904560128:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 331us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782858.368199:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 50 00010000:00010000:1.0:1787782858.368820:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b63779a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.368834:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b63779a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.368867:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b63779a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.368874:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b63779a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.368892:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b63779a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.368901:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0000 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782858.368905:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b63779a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.368914:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b63779a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.368938:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b63779a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.368946:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b63779a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782858.369027:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2350:x1874625904559872:12345-192.168.202.15@tcp:1:lfs.0 Request processed in 21307us (23448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782858.369036:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:1.0:1787782858.375078:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782858.375401:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904560384 00000100:00100000:2.0:1787782858.375414:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904560384 00000100:00100000:2.0:1787782858.375490:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:2.0:1787782858.375502:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310619f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+38:10528:x1874625904560384:12345-192.168.202.15@tcp:35:lfs.0 00000004:00010000:2.0:1787782858.375581:0:5854:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b63778c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e542e expref: 38 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787782858.376177:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1787782858.376229:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1787782858.376620:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1787782858.376683:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.376703:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637746 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e540b expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.376714:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377a1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.376759:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e540b expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.376777:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637746 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e540b expref: 42 pid: 5851 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782858.376816:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31347f4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5854:1874625922406016:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787782858.376942:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2300 going to sleep for 11 seconds 00000100:00100000:3.0:1787782858.380271:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782858.380434:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904560512 00000100:00100000:0.0:1787782858.380444:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904560512 00010000:00010000:0.0:1787782858.380500:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637746 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e540b expref: 43 pid: 5851 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782858.380575:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:0.0:1787782858.380587:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+43:2349:x1874625904560512:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782858.380610:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782858.380619:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637746 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e540b expref: 43 pid: 5851 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.380635:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637746 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e540b expref: 43 pid: 5851 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.380665:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c310823cb00) 00010000:00010000:0.0:1787782858.380671:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.380682:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.380691:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377a1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.380715:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782858.380793:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+43:2349:x1874625904560512:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 207us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782858.380803:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 51 00010000:00010000:2.0:1787782858.381172:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b637746 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e540b expref: 42 pid: 5851 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782858.381192:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31347f4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5854:1874625922406016:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787782858.381217:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.381226:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.381232:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787782858.381402:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787782858.381649:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1787782858.381784:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31347f4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5854:1874625922406144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787782858.381849:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782858.382030:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922406144 00000100:00100000:0.0:1787782858.382037:0:12025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922406144 00000100:00100000:0.0:1787782858.382089:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787782858.382129:0:12025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5854:x1874625922406144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787782858.382229:0:12025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5854:x1874625922406144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 103us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782858.382237:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787782858.383416:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782858.383461:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31347f4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5854:1874625922406144:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787782858.385181:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1787782858.385308:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31347f4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5854:1874625922406272:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787782858.385392:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782858.385444:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2300 going to sleep for 11 seconds 00000100:00100000:1.0:1787782858.385620:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922406272 00000100:00100000:1.0:1787782858.385630:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922406272 00000100:00100000:1.0:1787782858.385685:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787782858.385696:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1874625922406272:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787782858.385919:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5854:x1874625922406272:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 224us (526us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787782858.385929:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787782858.386283:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31347f4b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5854:1874625922406272:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787782858.386373:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1787782858.386423:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.386436:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377a1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.386446:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.386453:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782858.386458:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.386469:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377a1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.386490:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c310823cb00) 00010000:00010000:2.0:1787782858.386494:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787782858.386500:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377a1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.386507:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377a1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787782858.386727:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787782858.386856:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1787782858.386870:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343056773623ns, next at 344056770724ns, rc = 0 00000001:00080000:2.0:1787782858.386876:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1787782858.388533:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c310823cb00) 00010000:00010000:2.0:1787782858.388545:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787782858.388575:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b63778c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e542e expref: 46 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782858.388756:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310619f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+45:10528:x1874625904560384:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 13255us (13693us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1787782858.388768:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 26 00000020:00080000:2.0:1787782858.388776:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787782858.392288:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782858.392418:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904560640 00000100:00100000:2.0:1787782858.392431:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904560640 00000100:00100000:2.0:1787782858.392498:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 100 00000100:00100000:2.0:1787782858.392509:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+45:10528:x1874625904560640:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787782858.392540:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782858.392571:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204a00/0x6d98ed19b6377a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5435 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.392654:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204a00/0x6d98ed19b6377a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5435 expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.392671:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204a00/0x6d98ed19b6377a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5435 expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.392693:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:2.0:1787782858.392697:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787782858.392702:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204a00, rc 0) 00000100:00100000:2.0:1787782858.392778:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+46:10528:x1874625904560640:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 270us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782858.392786:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 100 00000100:00100000:3.0:1787782858.395878:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782858.396441:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904560896 00000100:00100000:1.0:1787782858.396455:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904560896 00000100:00100000:1.0:1787782858.396709:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:1.0:1787782858.396721:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+46:10528:x1874625904560896:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787782858.397195:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+47:10528:x1874625904560896:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 474us (1330us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1787782858.397204:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:3.0:1787782858.480538:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782858.480649:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904561024 00000100:00100000:1.0:1787782858.480663:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904561024 00000100:00100000:1.0:1787782858.480743:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:1.0:1787782858.480756:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+47:10538:x1874625904561024:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:1.0:1787782858.480862:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6377af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.480883:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6377af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.480897:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6377af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.480913:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.480919:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.480925:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481150:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b6377bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481159:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b6377bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481166:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b6377bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787782858.481218:0:6719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b6377bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481397:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6377af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481405:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6377af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481413:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6377af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481419:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782858.481424:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6377af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481433:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6377af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481448:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:1.0:1787782858.481451:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782858.481456:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6377af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481462:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6377af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481477:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481483:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481488:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481500:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782858.481503:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481509:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481516:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c312eeef500) 00010000:00010000:1.0:1787782858.481518:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782858.481521:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481526:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481542:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b6377bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481548:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b6377bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481553:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b6377bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481557:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782858.481559:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b6377bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481564:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b6377bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481580:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:1.0:1787782858.481582:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782858.481586:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b6377bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.481592:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b6377bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782858.481878:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+47:10538:x1874625904561024:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 1120us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782858.481897:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:3.0:1787782858.519652:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782858.519729:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904561280 00000100:00100000:2.0:1787782858.519743:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904561280 00000100:00100000:2.0:1787782858.520271:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 102 00000100:00100000:2.0:1787782858.520284:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+47:10541:x1874625904561280:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787782858.520314:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782858.520341:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b6377c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e543c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520454:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520473:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520486:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520505:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b6377d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520512:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b6377d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520519:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b6377d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520691:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b6377d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520724:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b6377d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520732:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b6377d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782858.520746:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787782858.520873:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520881:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520888:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520895:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782858.520900:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520908:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520922:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:2.0:1787782858.520925:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782858.520930:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520937:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b6377cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520974:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b6377d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520987:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b6377d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520993:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b6377d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.520999:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782858.521002:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b6377d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.521009:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b6377d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.521026:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3108738b00) 00010000:00010000:2.0:1787782858.521030:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782858.521033:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b6377d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.521039:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b6377d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.521091:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b6377c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e543c expref: 50 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.521162:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b6377d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e543c expref: 49 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.521171:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:2.0:1787782858.521173:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787782858.521183:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141205c00, rc 0) 00000100:00100000:2.0:1787782858.521271:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+49:10541:x1874625904561280:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 988us (1689us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787782858.521281:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 102 00000100:00100000:3.0:1787782858.524135:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782858.524208:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904561408 00000100:00100000:3.0:1787782858.524220:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904561408 00000100:00100000:3.0:1787782858.524296:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 103 00000100:00100000:3.0:1787782858.524308:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+49:10541:x1874625904561408:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:3.0:1787782858.524394:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6377e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.524415:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6377e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.524428:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6377e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.524458:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6377e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.524465:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6377e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.524473:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6377e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.524500:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782858.524505:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6377e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.524513:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6377e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.524526:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:3.0:1787782858.524529:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787782858.524535:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6377e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.524541:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b6377e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782858.524634:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+49:10541:x1874625904561408:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 327us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782858.524641:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 103 00000100:00100000:3.0:1787782858.527387:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782858.527541:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904561664 00000100:00100000:2.0:1787782858.527554:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904561664 00000100:00100000:2.0:1787782858.527748:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:2.0:1787782858.527761:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+49:10541:x1874625904561664:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787782858.528317:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+50:10541:x1874625904561664:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 556us (943us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787782858.528327:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:3.0:1787782858.588926:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782858.589063:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904561920 00000100:00100000:1.0:1787782858.589077:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904561920 00000100:00100000:1.0:1787782858.589226:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 104 00000100:00100000:1.0:1787782858.589239:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+50:10551:x1874625904561920:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787782858.589275:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782858.589279:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787782858.589323:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637769 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5420 expref: 50 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.589349:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:1.0:1787782858.589356:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787782858.589374:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b6377ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5443 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.589516:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.589534:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b6377d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e543c expref: 50 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.589570:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377f5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.589691:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b6377d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e543c expref: 50 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.589708:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b6377d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e543c expref: 50 pid: 5852 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782858.589727:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344efc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922406400:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782858.589867:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3104d66000 going to sleep for 11 seconds 00000100:00100000:1.0:1787782858.592853:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344efc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922406400:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782858.592904:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782858.593739:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782858.594477:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904562048 00000100:00100000:1.0:1787782858.594490:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904562048 00010000:00010000:1.0:1787782858.594548:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b6377d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e543c expref: 51 pid: 5852 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782858.594705:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:1.0:1787782858.594717:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+51:2350:x1874625904562048:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782858.594740:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782858.594749:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b6377d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e543c expref: 51 pid: 5852 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.594786:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b6377d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e543c expref: 51 pid: 5852 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.594818:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b6377d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e543c expref: 51 pid: 5852 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.594844:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:1.0:1787782858.594852:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.594863:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.594873:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377f5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.594916:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782858.595002:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.595013:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782858.595045:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:1.0:1787782858.595073:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+50:2350:x1874625904562048:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 358us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782858.595082:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 52 00010000:00010000:2.0:1787782858.595279:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b6377ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5443 expref: 51 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.595301:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5443 expref: 50 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.595309:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:2.0:1787782858.595312:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787782858.595315:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6600, rc 0) 00000100:00100000:2.0:1787782858.595344:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+50:10551:x1874625904561920:12345-192.168.202.15@tcp:101:bash.0 Request processed in 6109us (6436us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787782858.595363:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 104 00000100:00100000:3.0:1787782858.598217:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782858.598357:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904562304 00000100:00100000:2.0:1787782858.598370:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904562304 00000100:00100000:2.0:1787782858.598457:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 105 00000100:00100000:2.0:1787782858.598468:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+50:10551:x1874625904562304:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:2.0:1787782858.599169:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637803 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.599196:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637803 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.599209:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637803 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787782858.599831:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787782858.599871:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009666c211 reply state 00000000a7210795 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637803 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782858.600011:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787782858.602244:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+53:10551:x1874625904562304:12345-192.168.202.15@tcp:36:bash.0 Request processed in 3759us (4026us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787782858.602261:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 105 00000020:00080000:2.0:1787782858.602273:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787782858.605068:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637803 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.605133:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637803 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.605145:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637803 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.605153:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782858.605158:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637803 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.605168:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637803 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.605191:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:0.0:1787782858.605196:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782858.605202:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637803 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.605209:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637803 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782858.606979:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782858.607234:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904562432 00000100:00100000:2.0:1787782858.607247:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904562432 00000100:00100000:2.0:1787782858.607322:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 106 00000100:00100000:2.0:1787782858.607334:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+52:10551:x1874625904562432:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787782858.607368:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782858.607580:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b63780a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e544a expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.607693:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.607712:0:6719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5443 expref: 53 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.607722:0:6719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.607766:0:6719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5443 expref: 53 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.607784:0:6719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5443 expref: 53 pid: 5853 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782858.607801:0:6719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31347f6940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6719:1874625922406528:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787782858.607901:0:6719:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787782858.610406:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782858.610482:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904562560 00000100:00100000:0.0:1787782858.610492:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904562560 00000100:00100000:2.0:1787782858.610502:0:6719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31347f6940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6719:1874625922406528:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787782858.610538:0:6719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.610543:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5443 expref: 54 pid: 5853 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782858.610614:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:0.0:1787782858.610625:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+54:2349:x1874625904562560:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782858.610648:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782858.610656:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5443 expref: 54 pid: 5853 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.610666:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5443 expref: 54 pid: 5853 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.610691:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6377f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5443 expref: 54 pid: 5853 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.610708:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:0.0:1787782858.610712:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.610721:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.610727:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.610751:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782858.610769:0:6719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.610776:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782858.610824:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+53:2349:x1874625904562560:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 201us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782858.610832:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00000004:00200000:2.0:1787782858.610853:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787782858.610859:0:6719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782858.611824:0:6719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.611877:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b63780a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e544a expref: 53 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.612004:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e544a expref: 52 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.612014:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:2.0:1787782858.612026:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787782858.612029:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204400, rc 0) 00000100:00100000:2.0:1787782858.612153:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+52:10551:x1874625904562432:12345-192.168.202.15@tcp:101:bash.0 Request processed in 4820us (5189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782858.612162:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 106 00000100:00100000:3.0:1787782858.615049:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782858.615144:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904562816 00000100:00100000:1.0:1787782858.615157:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904562816 00000100:00100000:1.0:1787782858.615225:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:1.0:1787782858.615236:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+52:10551:x1874625904562816:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:1.0:1787782858.616513:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+53:10551:x1874625904562816:12345-192.168.202.15@tcp:35:bash.0 Request processed in 1266us (1468us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787782858.616528:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:3.0:1787782858.683724:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782858.683812:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904562944 00000100:00100000:2.0:1787782858.683826:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904562944 00000100:00100000:2.0:1787782858.684347:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 107 00000100:00100000:2.0:1787782858.684363:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+53:10557:x1874625904562944:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787782858.684498:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782858.684528:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637818 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5451 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.684624:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b63781f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.684667:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b63781f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.684682:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b63781f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782858.684772:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787782858.684777:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782858.684807:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b63781f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.684839:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637818 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5451 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.684869:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b63781f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5451 expref: 54 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.685530:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:2.0:1787782858.685538:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787782858.685544:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204600, rc 0) 00000100:00100000:2.0:1787782858.685655:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+54:10557:x1874625904562944:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1294us (1943us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782858.685666:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 107 00000100:00100000:0.0:1787782858.689336:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782858.689432:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904563072 00000100:00100000:1.0:1787782858.689446:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904563072 00000100:00100000:1.0:1787782858.689555:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 108 00000100:00100000:1.0:1787782858.689568:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141211e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+54:10557:x1874625904563072:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787782858.689597:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782858.689626:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b637826 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5458 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.689718:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63782d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.689738:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63782d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.689753:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63782d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.689771:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637834 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.689779:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.689786:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.689937:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b63783b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.689957:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b63783b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.689979:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b63783b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782858.690042:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787782858.690047:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787782858.690073:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b63783b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690088:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b63783b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690141:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63782d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690149:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63782d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690156:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63782d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690162:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782858.690167:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63782d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690176:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63782d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690190:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:1.0:1787782858.690193:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782858.690198:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63782d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690216:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63782d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690233:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690240:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637834 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690257:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637834 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690263:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782858.690266:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637834 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690273:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637834 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690281:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c312eeef500) 00010000:00010000:1.0:1787782858.690284:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782858.690287:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637834 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690294:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637834 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690345:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b637826 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5458 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690362:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b63783b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5458 expref: 55 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782858.690377:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:1.0:1787782858.690380:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782858.690383:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6200, rc 0) 00000100:00100000:1.0:1787782858.690468:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141211e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+55:10557:x1874625904563072:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 901us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782858.690476:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 108 00000100:00100000:3.0:1787782858.693521:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782858.693572:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782858.693590:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904563328 00000100:00100000:0.0:1787782858.693603:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904563328 00000100:00100000:3.0:1787782858.693635:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904563456 00000100:00100000:3.0:1787782858.693638:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904563456 00000100:00100000:0.0:1787782858.693668:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 109 00000100:00100000:3.0:1787782858.693677:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:0.0:1787782858.693678:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+56:10557:x1874625904563328:12345-192.168.202.15@tcp:101:lfs.0 00000100:00100000:3.0:1787782858.693683:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+56:2350:x1874625904563456:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782858.693700:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782858.693701:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782858.693728:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b63783b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5458 expref: 56 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.693735:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637842 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e545f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.693751:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:3.0:1787782858.693757:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782858.693821:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+56:2350:x1874625904563456:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 137us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782858.693828:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00010000:00010000:0.0:1787782858.693853:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637849 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.693867:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e544a expref: 55 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.693876:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637849 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.693930:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e544a expref: 55 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.693944:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e544a expref: 55 pid: 6719 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782858.693972:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31412103c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1874625922406656:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787782858.694071:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782858.697241:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31412103c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1874625922406656:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787782858.697293:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637849 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782858.697462:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782858.697572:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904563584 00000100:00100000:0.0:1787782858.697581:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904563584 00010000:00010000:0.0:1787782858.697627:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e544a expref: 56 pid: 6719 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782858.697681:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 54 00000100:00100000:0.0:1787782858.697692:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102e13050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+56:2349:x1874625904563584:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782858.697712:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782858.697720:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e544a expref: 56 pid: 6719 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.697734:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e544a expref: 56 pid: 6719 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.697763:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637811 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e544a expref: 56 pid: 6719 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.697787:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:0.0:1787782858.697793:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637849 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.697805:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637849 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.697816:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637849 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.697842:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782858.697920:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102e13050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+55:2349:x1874625904563584:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 229us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782858.697929:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 54 00010000:00010000:3.0:1787782858.698157:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637849 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.698166:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637849 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782858.698189:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787782858.698414:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637842 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e545f expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.698432:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637849 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e545f expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.698441:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:3.0:1787782858.698452:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787782858.698456:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254e00, rc 0) 00000100:00100000:3.0:1787782858.698491:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+55:10557:x1874625904563328:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 4814us (4990us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1787782858.698499:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 109 00000100:00100000:3.0:1787782858.701388:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782858.701818:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904563840 00000100:00100000:0.0:1787782858.701831:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904563840 00000100:00100000:0.0:1787782858.701904:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:0.0:1787782858.701914:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+55:10557:x1874625904563840:12345-192.168.202.15@tcp:103:lfs.0 00010000:00010000:0.0:1787782858.701934:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782858.701965:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204a00/0x6d98ed19b6377a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5435 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782858.701992:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:0.0:1787782858.701998:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782858.702070:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+54:10557:x1874625904563840:12345-192.168.202.15@tcp:103:lfs.0 Request processed in 158us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782858.702079:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:0.0:1787782858.705276:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782858.705395:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904563968 00000100:00100000:2.0:1787782858.705406:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904563968 00000100:00100000:2.0:1787782858.705469:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 110 00000100:00100000:2.0:1787782858.705481:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31412103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+54:10557:x1874625904563968:12345-192.168.202.15@tcp:58:lfs.0 00010000:00010000:2.0:1787782858.705649:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637857 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.705672:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637857 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782858.705683:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637857 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787782858.705952:0:6719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787782858.706073:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31412103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+54:10557:x1874625904563968:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 593us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782858.706082:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 110 00000100:00100000:2.0:1787782858.708068:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782858.708127:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904564096 00000100:00100000:3.0:1787782858.708138:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904564096 00000100:00100000:3.0:1787782858.708208:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 111 00000100:00100000:3.0:1787782858.708220:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+54:10557:x1874625904564096:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787782858.708246:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782858.708271:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b63785e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5466 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.708344:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637857 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.708357:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b63785e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5466 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.708464:0:5851:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637857 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.708480:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b63785e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5466 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.708496:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:3.0:1787782858.708499:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787782858.708521:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b63785e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5466 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782858.708530:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1a00, rc 0) 00000100:00100000:3.0:1787782858.708597:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+55:10557:x1874625904564096:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 379us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782858.708605:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 111 00000100:00100000:3.0:1787782858.849778:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3141213840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922406784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782858.849902:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787782858.850166:0:6959:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343520069105ns, next at 344520066047ns, rc = 0 00000100:00100000:1.0:1787782858.850189:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787782858.850201:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31344efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922406912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782858.850240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782858.850286:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922406784 00000100:00100000:1.0:1787782858.850295:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922406784 00000100:00100000:1.0:1787782858.850348:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922406912 00000100:00100000:1.0:1787782858.850351:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922406912 00000100:00100000:1.0:1787782858.850368:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787782858.850378:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625922406784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787782858.850409:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782858.850462:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625922406784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782858.850470:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787782858.850491:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787782858.850498:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922406912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782858.850527:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782858.850560:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922406912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782858.850597:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787782858.850652:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31344efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922406912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782858.850688:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3141213840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922406784:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787782859.106329:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787782859.425749:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787782859.425764:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787782859.425859:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787782859.425866:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787782859.426740:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3141212580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874625922407040:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787782859.429290:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782859.431593:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3141212580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874625922407040:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787782859.434901:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782859.438845:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904564224 00000100:00100000:3.0:1787782859.438867:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904564224 00000100:00100000:3.0:1787782859.439214:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 112 00000100:00100000:3.0:1787782859.439228:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141212580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+55:10558:x1874625904564224:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787782859.439274:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787782859.439431:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141212580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+55:10558:x1874625904564224:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 206us (4544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782859.439439:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 112 00000100:00100000:2.0:1787782859.444503:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00080000:1.0:1787782859.444692:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782859.444778:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904564352 00000100:00100000:3.0:1787782859.444791:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904564352 00000100:00100000:3.0:1787782859.444931:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 113 00000100:00100000:3.0:1787782859.444956:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+55:10558:x1874625904564352:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787782859.445064:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637865 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.446551:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637865 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.446594:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637865 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450387:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b63786c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450422:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b63786c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450437:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b63786c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450471:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637873 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450481:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450489:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782859.450537:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787782859.450542:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787782859.450556:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450569:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637865 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450575:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637865 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450582:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637865 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450612:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782859.450617:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637865 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450625:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637865 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450639:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c312eeef700) 00010000:00010000:3.0:1787782859.450642:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782859.450646:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637865 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450651:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637865 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450666:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b63786c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450671:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b63786c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450677:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b63786c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450682:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782859.450685:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b63786c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450690:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b63786c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450709:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8c3104d6ee00) 00010000:00010000:3.0:1787782859.450711:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782859.450714:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b63786c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450719:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b63786c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450731:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450738:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637873 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450743:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637873 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450748:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782859.450865:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637873 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450873:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637873 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450880:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:3.0:1787782859.450882:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782859.450885:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637873 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.450890:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637873 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782859.451347:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+55:10558:x1874625904564352:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 Request processed in 6401us (6854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782859.451360:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 113 00000100:00100000:0.0:1787782859.455583:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782859.455856:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904564608 00000100:00100000:2.0:1787782859.455869:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904564608 00000100:00100000:2.0:1787782859.455961:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:2.0:1787782859.455973:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141212d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+55:10558:x1874625904564608:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787782859.456005:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782859.456045:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b63787a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e546d expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.456557:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b637881 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.456591:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b637881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.456606:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b637881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782859.456639:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787782859.457069:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b637881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.457079:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b637881 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.457087:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b637881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.457405:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782859.457410:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b637881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.457419:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b637881 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.457434:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:2.0:1787782859.457437:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787782859.457443:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b637881 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.457449:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b637881 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.457512:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b63787a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e546d expref: 57 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.457524:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c312eeef700) 00010000:00010000:2.0:1787782859.457527:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787782859.457546:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b63787a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e546d expref: 57 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.457557:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141205800, rc 0) 00000100:00100000:2.0:1787782859.457711:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141212d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+56:10558:x1874625904564608:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 1738us (2143us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787782859.457721:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:0.0:1787782859.488118:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782859.488261:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904564736 00000100:00100000:3.0:1787782859.488275:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904564736 00000100:00100000:2.0:1787782859.498344:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:2.0:1787782859.498385:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31412121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+56:10558:x1874625904564736:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787782859.498476:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787782859.498636:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31412121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+56:10558:x1874625904564736:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 277us (10551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782859.498643:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:3.0:1787782859.505848:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782859.508504:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904564992 00000100:00100000:2.0:1787782859.508525:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904564992 00000100:00100000:2.0:1787782859.508925:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:2.0:1787782859.508937:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110740f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+56:10558:x1874625904564992:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787782859.509138:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782859.509143:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787782859.509180:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b63781f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5451 expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.509209:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:2.0:1787782859.509214:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782859.509230:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b63788f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5474 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787782859.513276:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787782859.514036:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205400/0x6d98ed19b637896 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.514076:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205400/0x6d98ed19b637896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.514091:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205400/0x6d98ed19b637896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.514501:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b63788f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5474 expref: 58 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.514534:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205400/0x6d98ed19b637896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5474 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.514544:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c3108738b00) 00010000:00010000:2.0:1787782859.514547:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787782859.514550:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141205400, rc 0) 00000100:00100000:2.0:1787782859.514628:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110740f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+57:10558:x1874625904564992:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 5693us (8795us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787782859.514638:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 116 00000100:00100000:0.0:1787782859.519841:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782859.519911:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904565248 00000100:00100000:1.0:1787782859.519924:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904565248 00000100:00100000:1.0:1787782859.520269:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 117 00000100:00100000:1.0:1787782859.520282:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141211680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+57:10558:x1874625904565248:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787782859.520379:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782859.520412:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205400/0x6d98ed19b637896 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5474 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520438:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c3108738b00) 00010000:00010000:1.0:1787782859.520451:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787782859.520476:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6378a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520492:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6378a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520503:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6378a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520518:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6378ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x96ac4700 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520524:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6378ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x96ac4700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520552:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6378ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x96ac4700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520655:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6378a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520663:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6378a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520677:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6378a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520684:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782859.520689:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6378a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520697:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6378a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520705:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:1.0:1787782859.520708:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782859.520712:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6378a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520719:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6378a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520728:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6378ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x96ac4700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520734:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6378ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x96ac4700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520746:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6378ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x96ac4700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520751:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782859.520754:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6378ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x96ac4700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520760:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6378ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x96ac4700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520766:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x96ac4700 (ffff8c312eeef500) 00010000:00010000:1.0:1787782859.520768:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782859.520771:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6378ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x96ac4700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.520777:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b6378ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x96ac4700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782859.520876:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141211680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+56:10558:x1874625904565248:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 595us (1048us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787782859.520884:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 117 00000100:00100000:0.0:1787782859.525709:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782859.527284:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904565376 00000100:00100000:1.0:1787782859.527302:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904565376 00000100:00100000:1.0:1787782859.527442:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 118 00000100:00100000:1.0:1787782859.527456:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3141213840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+56:10558:x1874625904565376:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787782859.527497:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782859.527529:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6378b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e547b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.527610:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b6378b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.527627:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b6378b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.527640:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b6378b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.527775:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b6378b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e547b expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.527796:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b6378b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e547b expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.527805:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:1.0:1787782859.527809:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787782859.527812:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7a00, rc 0) 00000100:00100000:1.0:1787782859.527903:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3141213840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+57:10558:x1874625904565376:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 450us (2210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782859.527910:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 118 00000100:00100000:2.0:1787782859.532358:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782859.532825:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904565632 00000100:00100000:3.0:1787782859.532839:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904565632 00000100:00100000:3.0:1787782859.532924:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 119 00000100:00100000:3.0:1787782859.532937:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+57:10558:x1874625904565632:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787782859.533073:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.533126:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.533141:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787782859.533615:0:6719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:3.0:1787782859.533733:0:6719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007682facc reply state 000000007fa24428 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782859.533743:0:6719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787782859.533863:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+59:10558:x1874625904565632:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 928us (1520us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787782859.536205:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 119 00000100:00100000:0.0:1787782859.536797:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782859.536834:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904565760 00000100:00100000:0.0:1787782859.536845:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904565760 00000100:00100000:0.0:1787782859.536917:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:0.0:1787782859.536929:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+59:10558:x1874625904565760:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787782859.536971:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782859.536998:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6378c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5482 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.537124:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6378c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5482 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.537142:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6378c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5482 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.537167:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:0.0:1787782859.537171:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787782859.537177:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255800, rc 0) 00000100:00100000:0.0:1787782859.537255:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+60:10558:x1874625904565760:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 328us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782859.537262:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 120 00010000:00010000:3.0:1787782859.540243:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.540287:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.540296:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.540304:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782859.540310:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.540393:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.540415:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:3.0:1787782859.540418:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787782859.540424:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.540430:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782859.540844:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782859.540965:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904565888 00000100:00100000:1.0:1787782859.540978:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904565888 00000100:00100000:1.0:1787782859.541076:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:1.0:1787782859.541089:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2349:x1874625904565888:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787782859.541496:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2349:x1874625904565888:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 409us (657us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787782859.541521:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00080000:3.0:1787782859.541804:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782859.547584:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782859.547919:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904566144 00000100:00100000:2.0:1787782859.547933:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904566144 00000100:00100000:2.0:1787782859.548028:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:2.0:1787782859.548040:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+59:10558:x1874625904566144:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787782859.548910:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+60:10558:x1874625904566144:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 867us (1334us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787782859.548920:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:0.0:1787782859.553874:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782859.554247:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904566400 00000100:00100000:1.0:1787782859.554260:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904566400 00000100:00100000:1.0:1787782859.554388:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:1.0:1787782859.554400:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+60:10558:x1874625904566400:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787782859.554561:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+60:10558:x1874625904566400:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 163us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782859.554569:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 121 00000100:00100000:0.0:1787782859.557073:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782859.557245:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904566528 00000100:00100000:2.0:1787782859.557257:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904566528 00000100:00100000:2.0:1787782859.557331:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00100000:2.0:1787782859.557342:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f38a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+60:10558:x1874625904566528:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787782859.557368:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782859.557396:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b6378ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5489 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.557488:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b6378d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.557506:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b6378d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.557520:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b6378d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782859.557579:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782859.557601:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b6378d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.557633:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b6378ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5489 expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.557661:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b6378d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5489 expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.557693:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:2.0:1787782859.557697:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787782859.557702:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141205000, rc 0) 00000100:00100000:2.0:1787782859.557786:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f38a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+61:10558:x1874625904566528:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 444us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782859.557794:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00100000:2.0:1787782859.561875:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782859.561982:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904566656 00000100:00100000:3.0:1787782859.561997:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904566656 00000100:00100000:3.0:1787782859.562086:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:3.0:1787782859.562222:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2350:x1874625904566656:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787782859.562247:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782859.562276:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000088b0817/0x6d98ed19b6378dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5490 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787782859.562332:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f66cb, blocks: 0x1 00010000:00010000:3.0:1787782859.562361:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:3.0:1787782859.562367:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782859.562379:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000088b0817/0x6d98ed19b6378dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5490 expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.562403:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000088b0817/0x6d98ed19b6378dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5490 expref: 10 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.562419:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1c00, rc 0) 00000100:00100000:3.0:1787782859.562486:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+10:2350:x1874625904566656:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 272us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782859.562494:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:1.0:1787782859.564772:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782859.564895:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904566912 00000100:00100000:0.0:1787782859.564925:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904566912 00000100:00100000:0.0:1787782859.565016:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 123 00000100:00100000:0.0:1787782859.565027:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+61:10558:x1874625904566912:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787782859.565198:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+61:10558:x1874625904566912:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 172us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782859.565207:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 123 00000100:00100000:0.0:1787782859.575336:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782859.575403:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904567040 00000100:00100000:1.0:1787782859.575419:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904567040 00000100:00100000:1.0:1787782859.575507:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:1.0:1787782859.575519:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eff83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+10:10558:x1874625904567040:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787782859.575546:0:6967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782859.575584:0:6967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b6378e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5497 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.575626:0:6967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000088b0817/0x6d98ed19b6378dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5490 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.575637:0:6967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782859.575642:0:6967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782859.575648:0:6967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b6378e3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5497 expref: 11 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.575728:0:6967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000088b0817/0x6d98ed19b6378dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5490 expref: 11 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.575744:0:6967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000088b0817/0x6d98ed19b6378dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5490 expref: 11 pid: 6697 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782859.575761:0:6967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2c9680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6967:1874625922407168:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782859.575905:0:6967:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3104d66000 going to sleep for 11 seconds 00000100:00100000:1.0:1787782859.580667:0:6967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2c9680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6967:1874625922407168:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782859.580725:0:6967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b6378e3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5497 expref: 11 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.580754:0:6967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7e00, rc 0) 00000100:00100000:1.0:1787782859.580903:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eff83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+11:10558:x1874625904567040:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 5384us (5577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782859.580914:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:0.0:1787782859.581700:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782859.582127:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904567168 00000100:00100000:3.0:1787782859.582139:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904567168 00010000:00010000:3.0:1787782859.582189:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000088b0817/0x6d98ed19b6378dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5490 expref: 11 pid: 6697 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782859.582235:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:3.0:1787782859.582248:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eff92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+11:2349:x1874625904567168:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782859.582272:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782859.582301:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000088b0817/0x6d98ed19b6378dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5490 expref: 11 pid: 6697 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.582340:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000088b0817/0x6d98ed19b6378dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5490 expref: 11 pid: 6697 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.582369:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000088b0817/0x6d98ed19b6378dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5490 expref: 11 pid: 6697 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.582391:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782859.582396:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782859.582405:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b6378e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5497 expref: 10 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.582417:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b6378e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5497 expref: 10 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.582463:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b6378e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5497 expref: 10 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782859.582481:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3110740b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1874625922407296:192.168.202.15@tcp:105: 00000100:00100000:3.0:1787782859.582600:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d1e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782859.590321:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3110740b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1874625922407296:192.168.202.15@tcp:105: 00010000:00010000:3.0:1787782859.590378:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782859.590460:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eff92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+10:2349:x1874625904567168:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 8213us (8765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782859.590477:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:1.0:1787782859.595687:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782859.595784:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904567296 00000100:00100000:0.0:1787782859.595799:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904567296 00002000:00100000:0.0:1787782859.595867:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8c312f2c9680 x1874625904567296/t0(0) o4->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:250/0 lens 504/0 e 0 to 0 dl 1787782870 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787782859.595880:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c312f2c9680 with x1874625904567296 ext(0->12) 00002000:00010000:0.0:1787782859.595886:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c312f2c9680 00000100:00100000:0.0:1787782859.595928:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:0.0:1787782859.595940:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+10:2351:x1874625904567296:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787782859.596617:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+12:2351:x1874625904567296:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 Request processed in 676us (942us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787782859.596628:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00002000:00100000:0.0:1787782859.596636:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8c312f2c9680 x1874625904567296/t4294967308(0) o4->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:250/0 lens 504/448 e 0 to 0 dl 1787782870 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787782859.596645:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c312f2c9680 with x1874625904567296 ext(0->12) 00002000:00010000:0.0:1787782859.596649:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c312f2c9680 00000100:00100000:0.0:1787782859.600853:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782859.601312:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904567424 00000100:00100000:2.0:1787782859.601326:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904567424 00000100:00100000:2.0:1787782859.601449:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 124 00000100:00100000:2.0:1787782859.601461:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eff9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+61:10558:x1874625904567424:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787782859.634579:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967376 is committed 00000020:00080000:1.0:1787782859.634609:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c3107d8e180 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1787782859.634615:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c3140db2000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c3107d8e000 00000020:00080000:1.0:1787782859.634619:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c3140db2500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c312edd6400 00000004:00080000:1.0:1787782859.634645:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:1.0:1787782859.634661:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967395 is committed 00000020:00080000:1.0:1787782859.634686:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:1.0:1787782859.634692:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1787782859.634722:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787782859.634737:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c31298f2cc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1787782859.634740:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c3129810200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c31298f2d80 00000020:00080000:1.0:1787782859.634743:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c3129810400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c313c800400 00000004:00080000:1.0:1787782859.634761:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:1.0:1787782859.634972:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922407424:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787782859.635072:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782859.635173:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922407424 00000100:00100000:1.0:1787782859.635181:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922407424 00000100:00100000:1.0:1787782859.635233:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787782859.635242:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922407424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787782859.635273:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1787782859.635303:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b6378ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.635330:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7a7c03d/0x6d98ed19b6376ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53f6 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.635340:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1787782859.635345:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787782859.635350:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b6378ea lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.635378:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7a7c03d/0x6d98ed19b6376ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53f6 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.635407:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7a7c03d/0x6d98ed19b6376ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53f6 expref: 11 pid: 6698 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782859.635421:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2ca940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874625922407552:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782859.635481:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3104d66e40 going to sleep for 11 seconds 00000020:00080000:3.0:1787782859.636532:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1787782859.636813:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787782859.641705:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782859.642659:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2ca940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874625922407552:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787782859.642698:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b6378ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782859.643331:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312effbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922407680:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787782859.643422:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782859.643914:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904567552 00000100:00100000:0.0:1787782859.643956:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904567552 00010000:00010000:0.0:1787782859.644023:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a7c03d/0x6d98ed19b6376ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53f6 expref: 12 pid: 6698 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782859.644072:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:0.0:1787782859.644083:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+12:2350:x1874625904567552:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782859.644131:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782859.644139:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7a7c03d/0x6d98ed19b6376ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53f6 expref: 12 pid: 6698 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.644155:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7a7c03d/0x6d98ed19b6376ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53f6 expref: 12 pid: 6698 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.644184:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7a7c03d/0x6d98ed19b6376ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.15@tcp remote: 0x7f762009527e53f6 expref: 12 pid: 6698 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.644204:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787782859.644209:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787782859.644216:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b6378ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.644227:0:7637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b6378ea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.644258:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782859.644320:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+11:2350:x1874625904567552:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 237us (2630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782859.644338:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:2.0:1787782859.644849:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eff9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+15:10558:x1874625904567424:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 Request processed in 43386us (44006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782859.644860:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 124 00000100:00100000:0.0:1787782859.645932:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922407680 00000100:00100000:0.0:1787782859.645947:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922407680 00000100:00100000:0.0:1787782859.646074:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787782859.646086:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110740b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625922407680:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787782859.646140:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1787782859.646183:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f66ca, atime: 0x6a8f66ca, ctime: 0x6a8f66ca, blocks: 0x1 00010000:00010000:0.0:1787782859.646192:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b6378f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.646215:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1787782859.646221:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782859.646228:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b6378f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.646246:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b6378f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.646257:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b6378f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.646266:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b6378f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.646292:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782859.647128:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782859.647140:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b6378f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.647153:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254600 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787782859.647158:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b6378f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.647169:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b6378f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.647206:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b6378f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.647214:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b6378f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.647236:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782859.647239:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782859.647240:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782859.648285:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b6378ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.648303:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b6378ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.648314:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b6378ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.648322:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b6378ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.648353:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787782859.649321:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2cb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1874625922407424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14073us (14243us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787782859.649335:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1787782859.651721:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c312f2cbc00/2, rc 0, transno 4294967309 00000100:00100000:1.0:1787782859.651750:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2cbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922407424:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787782859.651863:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782859.651980:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904567680 00000100:00100000:1.0:1787782859.651989:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904567680 00000100:00100000:1.0:1787782859.652056:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:1.0:1787782859.652066:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+11:2350:x1874625904567680:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787782859.652584:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110740b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1874625922407680:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6496us (9157us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787782859.652612:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1787782859.653662:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782859.653680:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b6378ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.653698:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7c00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782859.653705:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b6378ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.653719:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b6378ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.653746:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b6378ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.653755:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b6378ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.653783:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782859.653785:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782859.653787:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787782859.661133:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c312effbc00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787782859.661153:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312effbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922407680:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1787782859.715091:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1787782859.715844:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2350:x1874625904567680:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 Request processed in 63767us (63973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782859.715860:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:1.0:1787782859.720224:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782859.720342:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904567936 00000100:00100000:2.0:1787782859.720356:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904567936 00000100:00100000:2.0:1787782859.720441:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 125 00000100:00100000:2.0:1787782859.720452:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+15:10558:x1874625904567936:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787782859.720521:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782859.720559:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205000/0x6d98ed19b6378d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5489 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.720731:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:2.0:1787782859.720737:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782859.720777:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6378f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.720792:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6378f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.720804:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6378f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787782859.721586:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000063c4294 reply state 00000000d8f9ff0e transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6378f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782859.721604:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787782859.721760:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+16:10558:x1874625904567936:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 1307us (1548us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787782859.721771:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 125 00000001:00080000:0.0:1787782859.722281:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1787782859.726886:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782859.727778:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904568064 00000100:00100000:2.0:1787782859.727794:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904568064 00000100:00100000:2.0:1787782859.727887:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:2.0:1787782859.727898:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904568064:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787782859.728267:0:6967:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787782859.728271:0:6967:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787782858 00002000:00010000:2.0:1787782859.728275:0:6967:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787782858 00002000:00010000:2.0:1787782859.728277:0:6967:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787782859 -> 1787782858 00002000:00010000:2.0:1787782859.728280:0:6967:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787782859.728358:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2349:x1874625904568064:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 461us (1495us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787782859.728515:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:2.0:1787782859.737231:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782859.737548:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904568320 00000100:00100000:3.0:1787782859.737562:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904568320 00000100:00100000:3.0:1787782859.737650:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 126 00000100:00100000:3.0:1787782859.737661:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+16:10558:x1874625904568320:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787782859.737752:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.737771:0:6719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b6378b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e547b expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.737782:0:6719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378ff lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.737826:0:6719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b6378b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e547b expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.737859:0:6719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b6378b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e547b expref: 16 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782859.737887:0:6719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3110741a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6719:1874625922407808:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787782859.738195:0:6719:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3119d79180 going to sleep for 11 seconds 00000100:00100000:1.0:1787782859.741057:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782859.741692:0:6719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3110741a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6719:1874625922407808:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787782859.741731:0:6719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.741907:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6378f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.741918:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6378f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.741959:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6378f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.741966:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782859.741971:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6378f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.741981:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6378f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.742002:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:0.0:1787782859.742016:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782859.742022:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6378f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.742028:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6378f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782859.742653:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904568448 00000100:00100000:2.0:1787782859.742663:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904568448 00010000:00010000:2.0:1787782859.742710:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b6378b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e547b expref: 16 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782859.742793:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:2.0:1787782859.742805:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+16:2350:x1874625904568448:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782859.742827:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782859.742834:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b6378b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e547b expref: 16 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.742846:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b6378b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e547b expref: 16 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.742877:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b6378b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e547b expref: 16 pid: 5852 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.742890:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:2.0:1787782859.742895:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.742904:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.742912:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378ff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.743135:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782859.743215:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+15:2350:x1874625904568448:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 411us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782859.743225:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 57 00010000:00010000:0.0:1787782859.743294:0:6719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.743303:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.743339:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.743345:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.743352:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.743366:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782859.743371:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.743379:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.743389:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:0.0:1787782859.743392:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787782859.743395:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.743401:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6378ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782859.743447:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+14:10558:x1874625904568320:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 Request processed in 5788us (6232us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787782859.743456:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 126 00000100:00100000:1.0:1787782859.751131:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782859.751202:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904568576 00000100:00100000:1.0:1787782859.751215:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904568576 00000100:00100000:1.0:1787782859.751279:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:1.0:1787782859.751290:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2349:x1874625904568576:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787782859.751352:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010f4d317/0x6d98ed19b637906 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.751378:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b6378e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5497 expref: 7 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.751389:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782859.751394:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787782859.751399:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010f4d317/0x6d98ed19b637906 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.751445:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b6378e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5497 expref: 7 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.751461:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b6378e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5497 expref: 7 pid: 6967 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782859.751478:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874625922407936:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782859.751596:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3104d66f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787782859.756154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782859.756197:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904568704 00000100:00100000:1.0:1787782859.756209:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904568704 00010000:00010000:1.0:1787782859.756270:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b6378e3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5497 expref: 8 pid: 6967 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782859.756334:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00100000:1.0:1787782859.756346:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2350:x1874625904568704:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782859.756366:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782859.756398:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b6378e3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5497 expref: 8 pid: 6967 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.756414:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b6378e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5497 expref: 8 pid: 6967 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.756448:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787782859.756453:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787782859.756460:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000010f4d317/0x6d98ed19b637906 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.756472:0:7637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010f4d317/0x6d98ed19b637906 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.756498:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782859.756566:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2350:x1874625904568704:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 221us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782859.756587:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 58 00010000:00010000:3.0:1787782859.757244:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b6378e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5497 expref: 7 pid: 6967 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782859.757268:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6696:1874625922407936:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787782859.757294:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000010f4d317/0x6d98ed19b637906 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.757306:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000010f4d317/0x6d98ed19b637906 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.757314:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010f4d317/0x6d98ed19b637906 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.757352:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000010f4d317/0x6d98ed19b637906 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.757387:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010f4d317/0x6d98ed19b637906 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.757397:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010f4d317/0x6d98ed19b637906 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.757406:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7000 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787782859.757411:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010f4d317/0x6d98ed19b637906 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.757421:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010f4d317/0x6d98ed19b637906 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.757440:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010f4d317/0x6d98ed19b637906 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.757448:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010f4d317/0x6d98ed19b637906 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782859.757532:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904568576:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 Request processed in 6243us (6416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782859.757542:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:2.0:1787782859.763228:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782859.763351:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904568960 00000100:00100000:1.0:1787782859.763365:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904568960 00000100:00100000:1.0:1787782859.763445:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 127 00000100:00100000:1.0:1787782859.763456:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+14:10558:x1874625904568960:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787782859.763599:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b63790d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.763621:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b63790d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.763637:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b63790d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.764243:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637914 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.764261:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6378c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5482 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.764270:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637914 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.764317:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6378c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5482 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.764333:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6378c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5482 expref: 15 pid: 5851 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782859.764350:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2c8780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922408064:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782859.764460:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3104d66e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787782859.769069:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782859.769347:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904569088 00000100:00100000:2.0:1787782859.769359:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904569088 00010000:00010000:2.0:1787782859.769412:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6378c7 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5482 expref: 16 pid: 5851 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782859.769460:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:2.0:1787782859.769471:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2ca580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+16:2349:x1874625904569088:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782859.769495:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782859.769502:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6378c7 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5482 expref: 16 pid: 5851 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.769518:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6378c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5482 expref: 16 pid: 5851 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.769547:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:2.0:1787782859.769554:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637914 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.769564:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637914 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.769586:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637914 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.769630:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782859.769700:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2ca580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+16:2349:x1874625904569088:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 229us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782859.769708:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 59 00010000:00010000:3.0:1787782859.770371:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b6378c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5482 expref: 15 pid: 5851 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782859.770407:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2c8780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922408064:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787782859.770434:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637914 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.770444:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637914 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782859.770451:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637914 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787782859.770769:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1787782859.771846:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1787782859.771964:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1787782859.772151:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3110741a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5853:1874625922408192:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787782859.772238:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782859.772280:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31342f89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782859.772714:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922408192 00000100:00100000:0.0:1787782859.772724:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922408192 00000100:00100000:0.0:1787782859.772794:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787782859.772804:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31107403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1874625922408192:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787782859.772916:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31107403c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1874625922408192:12345-0@lo:1000:mdt00_002.0 Request processed in 113us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782859.772925:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787782859.773231:0:5853:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1787782859.773238:0:5853:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1787782859.773264:0:5853:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c312f2cbc00, transno 4294967309 00000100:00100000:3.0:1787782859.773291:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3110741a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5853:1874625922408192:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787782859.774784:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787782859.774896:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31347f6580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5853:1874625922408320:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787782859.775083:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782859.775151:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2600 going to sleep for 11 seconds 00000100:00100000:0.0:1787782859.775225:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922408320 00000100:00100000:0.0:1787782859.775232:0:12025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922408320 00000100:00100000:0.0:1787782859.775283:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787782859.775293:0:12025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eed92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5853:x1874625922408320:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787782859.775547:0:12025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eed92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5853:x1874625922408320:12345-0@lo:1000:mdt00_002.0 Request processed in 255us (464us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787782859.775556:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787782859.775772:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31347f6580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5853:1874625922408320:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787782859.775818:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637914 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.775829:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637914 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.775837:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637914 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.775844:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782859.775849:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637914 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.775859:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637914 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.776018:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c312eeef100) 00010000:00010000:2.0:1787782859.776023:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787782859.776030:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637914 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.776050:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637914 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.776091:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637857 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.776130:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637857 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.776136:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637857 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.776142:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782859.776145:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637857 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.776152:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637857 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.776160:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:2.0:1787782859.776163:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787782859.776172:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b63785e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5466 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.776185:0:5853:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b63785e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5466 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.776195:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b63785e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5466 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.776244:0:5853:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b63785e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5466 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782859.776259:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eedb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922408448:192.168.202.15@tcp:105: 00000100:00100000:2.0:1787782859.776340:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2600 going to sleep for 11 seconds 00000100:00100000:2.0:1787782859.784436:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782859.784573:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eedb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922408448:192.168.202.15@tcp:105: 00010000:00010000:1.0:1787782859.784612:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637857 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784643:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637857 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784694:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b63791b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784712:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b63791b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784725:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b63791b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784737:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b63791b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784743:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b63791b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784750:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b63791b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784756:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782859.784760:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b63791b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784768:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b63791b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784779:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:1.0:1787782859.784783:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782859.784787:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b63791b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784798:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b63791b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784809:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b63790d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784815:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b63790d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784822:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b63790d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784827:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782859.784830:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b63790d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784836:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b63790d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784842:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:1.0:1787782859.784845:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787782859.784847:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b63790d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.784852:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b63790d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782859.785193:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+18:10558:x1874625904568960:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 21736us (21979us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1787782859.785206:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 127 00000020:00080000:1.0:1787782859.785219:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787782859.785729:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904569216 00000100:00100000:3.0:1787782859.785740:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904569216 00000100:00100000:3.0:1787782859.785803:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:3.0:1787782859.785813:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+18:10557:x1874625904569216:12345-192.168.202.15@tcp:49:lfs.0 00000100:00100000:3.0:1787782859.785952:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+18:10557:x1874625904569216:12345-192.168.202.15@tcp:49:lfs.0 Request processed in 140us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782859.785971:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 31 00000040:00080000:0.0:1787782859.786255:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787782859.786260:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787782859.786769:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787782859.786779:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787782859.792911:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782859.792982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782859.793288:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904569728 00000100:00100000:3.0:1787782859.793302:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904569728 00000100:00100000:3.0:1787782859.793479:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:3.0:1787782859.793492:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310619e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+18:10558:x1874625904569728:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787782859.794922:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:0.0:1787782859.795988:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904569472 00000100:00100000:0.0:1787782859.796002:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904569472 00000100:00100000:0.0:1787782859.796091:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 128 00000100:00100000:0.0:1787782859.796129:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+20:10557:x1874625904569472:12345-192.168.202.15@tcp:58:lfs.0 00000001:00080000:2.0:1787782859.799698:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1787782859.799808:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637922 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.799830:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637922 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.799844:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637922 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.799855:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637922 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.799862:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637922 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.799868:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637922 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787782859.800726:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1787782859.800971:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+21:10557:x1874625904569472:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 4836us (8066us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782859.800985:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 128 00010000:00010000:2.0:1787782859.801053:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787782859.801159:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310619e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+20:10558:x1874625904569728:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 7670us (8175us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1787782859.801184:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 32 00000020:00080000:2.0:1787782859.801188:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787782859.804724:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782859.804745:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637922 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.804760:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204400 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782859.804765:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637922 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.804777:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637922 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.804802:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c3108738000) 00010000:00010000:1.0:1787782859.804806:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787782859.804811:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637922 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.804817:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637922 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.804856:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782859.804858:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782859.804860:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782859.867863:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782859.868065:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904569856 00000100:00100000:1.0:1787782859.868079:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904569856 00000100:00100000:2.0:1787782859.868291:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 129 00000100:00100000:2.0:1787782859.868307:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312effb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+20:10560:x1874625904569856:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787782859.868350:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782859.868380:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637929 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e549e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.868494:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637930 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.868513:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.868527:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.868545:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.868553:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.868559:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.868952:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b63793e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.868965:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637849 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e545f expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.868982:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b63793e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.869068:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637849 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e545f expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782859.869085:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637849 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e545f expref: 21 pid: 5851 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782859.869124:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e4780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922408576:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787782859.869247:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31298f2000 going to sleep for 11 seconds 00000100:00100000:0.0:1787782859.878161:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e4780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922408576:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787782859.878170:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:0.0:1787782859.878213:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b63793e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782859.878349:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904570112 00000100:00100000:3.0:1787782859.878360:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904570112 00000100:00100000:3.0:1787782859.878432:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:3.0:1787782859.878443:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+22:9245:x1874625904570112:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787782859.878753:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+23:9245:x1874625904570112:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 310us (582us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787782859.878763:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:0.0:1787782859.893191:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782859.893481:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904570240 00000100:00100000:1.0:1787782859.893494:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904570240 00010000:00010000:1.0:1787782859.893547:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637849 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e545f expref: 23 pid: 5851 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782859.893608:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:1.0:1787782859.893619:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102e12450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+23:2349:x1874625904570240:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782859.893658:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782859.893667:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637849 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e545f expref: 23 pid: 5851 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.893681:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637849 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e545f expref: 23 pid: 5851 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.893708:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637849 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e545f expref: 23 pid: 5851 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.893728:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:1.0:1787782859.893734:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b63793e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.893746:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b63793e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.893755:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b63793e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782859.893789:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782859.893865:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102e12450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+22:2349:x1874625904570240:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 246us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782859.893874:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 60 00010000:00010000:0.0:1787782859.893875:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b63793e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.893882:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b63793e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782859.893943:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787782859.893963:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787782859.893992:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b63793e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894018:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b63793e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894029:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894037:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637930 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894044:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637930 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894052:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782859.894056:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637930 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894065:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637930 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894075:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:0.0:1787782859.894077:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782859.894082:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637930 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894087:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637930 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894132:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894149:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637937 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894155:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894160:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782859.894163:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894169:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637937 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894177:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c3108738600) 00010000:00010000:0.0:1787782859.894180:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782859.894182:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637937 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894188:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637937 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894231:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637929 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e549e expref: 22 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894249:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b63793e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e549e expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782859.894257:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:0.0:1787782859.894259:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787782859.894270:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204c00, rc 0) 00000100:00100000:0.0:1787782859.894297:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312effb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+21:10560:x1874625904569856:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 25996us (26450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782859.894306:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 129 00010000:00010000:2.0:1787782860.135548:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782860.298512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782860.298569:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782860.298605:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782860.298645:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782860.298681:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782860.298717:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904570752 00000100:00100000:3.0:1787782860.298727:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904570752 00000100:00100000:3.0:1787782860.298803:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904570624 00000100:00100000:3.0:1787782860.298807:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904570624 00000100:00100000:3.0:1787782860.298831:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:3.0:1787782860.298843:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2352:x1874625904570752:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782860.298933:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2352:x1874625904570752:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 92us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782860.298948:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:3.0:1787782860.298969:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:3.0:1787782860.298977:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2352:x1874625904570624:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782860.299015:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2352:x1874625904570624:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 39us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782860.299021:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:3.0:1787782860.299041:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904570368 00000100:00100000:3.0:1787782860.299045:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904570368 00000100:00100000:3.0:1787782860.299072:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 295 00000100:00100000:3.0:1787782860.299079:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2352:x1874625904570368:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782860.299138:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2352:x1874625904570368:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 59us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782860.299145:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 295 00000100:00100000:3.0:1787782860.299182:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904570496 00000100:00100000:3.0:1787782860.299186:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904570496 00000100:00100000:3.0:1787782860.299227:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904570880 00000100:00100000:3.0:1787782860.299230:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904570880 00000100:00100000:3.0:1787782860.299255:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 149 00000100:00100000:3.0:1787782860.299261:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110741a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+21:2352:x1874625904570496:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782860.299295:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110741a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+21:2352:x1874625904570496:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 35us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782860.299302:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 149 00000100:00100000:3.0:1787782860.299313:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 150 00000100:00100000:3.0:1787782860.299320:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2352:x1874625904570880:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782860.299354:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2352:x1874625904570880:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 34us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782860.299360:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 150 00000100:00080000:3.0:1787782860.299377:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787782860.299383:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1787782860.833565:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787782860.833579:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787782860.833632:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787782860.833640:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787782860.833805:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312effa1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874625922408704:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787782860.833946:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787782860.837838:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782860.837931:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312effa1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874625922408704:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787782860.838322:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904571008 00000100:00100000:1.0:1787782860.838331:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904571008 00000100:00100000:1.0:1787782860.838413:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 130 00000100:00100000:1.0:1787782860.838424:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+21:10572:x1874625904571008:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787782860.838496:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787782860.838641:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+21:10572:x1874625904571008:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 217us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782860.838649:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 130 00000100:00100000:3.0:1787782860.845643:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782860.848596:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904571264 00000100:00100000:0.0:1787782860.848618:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904571264 00000100:00100000:0.0:1787782860.848717:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 131 00000100:00100000:0.0:1787782860.848730:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+21:10572:x1874625904571264:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787782860.848757:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782860.848786:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637945 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e54a5 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782860.848918:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b63794c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782860.848935:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b63794c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782860.848951:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b63794c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782860.848963:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787782860.850064:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637945 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54a5 expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782860.850137:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b63794c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54a5 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782860.850147:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:1.0:1787782860.850150:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782860.850154:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254200, rc 0) 00000100:00100000:1.0:1787782860.850247:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+23:10572:x1874625904571264:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 1519us (4616us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787782860.850256:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 131 00000100:00100000:0.0:1787782860.855650:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782860.858088:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782860.858266:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904571648 00000100:00100000:1.0:1787782860.858279:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904571648 00000100:00100000:1.0:1787782860.858347:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 132 00000100:00100000:1.0:1787782860.858361:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+23:10572:x1874625904571648:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787782860.858481:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63795a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782860.858503:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63795a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782860.858518:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63795a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782860.858792:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63795a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782860.858801:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63795a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782860.858807:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63795a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782860.858814:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782860.858819:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63795a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782860.858827:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63795a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782860.858842:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:1.0:1787782860.858846:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787782860.858851:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63795a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782860.858859:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b63795a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782860.859064:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+24:10572:x1874625904571648:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 705us (999us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787782860.859073:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 132 00000040:00080000:0.0:1787782860.859492:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787782860.859498:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787782860.860017:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787782860.860029:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787782860.864047:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782860.864249:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904571904 00000100:00100000:1.0:1787782860.864262:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904571904 00000100:00100000:1.0:1787782860.864331:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:1.0:1787782860.864363:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eff9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+24:10572:x1874625904571904:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787782860.864771:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eff9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+25:10572:x1874625904571904:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 409us (739us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1787782860.864781:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:2.0:1787782860.866713:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904571392 00000100:00100000:2.0:1787782860.866731:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904571392 00000100:00100000:2.0:1787782860.866820:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:2.0:1787782860.866831:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312effa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+25:2351:x1874625904571392:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782860.866853:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782860.866886:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b63794c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54a5 expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782860.866910:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:2.0:1787782860.866917:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782860.866988:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312effa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+24:2351:x1874625904571392:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 159us (11352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782860.867005:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000040:00080000:2.0:1787782861.128667:0:12117:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787782861.128683:0:12117:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787782861.128737:0:12117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787782861.128745:0:12117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787782861.156796:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782861.381391:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782861.381517:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904572160 00000100:00100000:2.0:1787782861.381527:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904572160 00000100:00100000:2.0:1787782861.381624:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 133 00000100:00100000:2.0:1787782861.381635:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eff8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+24:10585:x1874625904572160:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787782861.381669:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1787782861.381670:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787782861.381691:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637961 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e54ac expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782861.381814:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b637968 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782861.381829:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b637968 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782861.381843:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b637968 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782861.381854:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787782861.381981:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637961 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54ac expref: 27 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782861.382012:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b637968 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54ac expref: 26 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782861.382022:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:2.0:1787782861.382025:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787782861.382038:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204800, rc 0) 00000100:00100000:2.0:1787782861.382161:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eff8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+26:10585:x1874625904572160:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 528us (777us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787782861.382170:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 133 00000100:00100000:1.0:1787782861.386402:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782861.386545:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904572288 00000100:00100000:3.0:1787782861.386555:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904572288 00000100:00100000:3.0:1787782861.386608:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 134 00000100:00100000:3.0:1787782861.386615:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+26:10585:x1874625904572288:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:3.0:1787782861.386674:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637976 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782861.386688:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782861.386697:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782861.386717:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782861.386722:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637976 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782861.386727:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782861.386744:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782861.386747:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782861.386753:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637976 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782861.386762:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:3.0:1787782861.386764:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787782861.386767:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637976 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782861.386771:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0a00/0x6d98ed19b637976 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782861.387886:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+26:10585:x1874625904572288:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 1267us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782861.387895:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 134 00000100:00100000:0.0:1787782861.503545:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782861.504008:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904572416 00000100:00100000:3.0:1787782861.504018:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904572416 00000100:00100000:3.0:1787782861.504143:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:3.0:1787782861.504154:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312effa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2351:x1874625904572416:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:3.0:1787782861.504172:0:6967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782861.504191:0:6967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005416bc48/0x6d98ed19b63797d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e54b3 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787782861.504256:0:6967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f66ca, atime: 0x6a8f66ca, ctime: 0x6a8f66ca, blocks: 0xb 00010000:00010000:3.0:1787782861.504550:0:6967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1787782861.504568:0:6967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782861.504579:0:6967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005416bc48/0x6d98ed19b63797d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54b3 expref: 7 pid: 6967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782861.504601:0:6967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005416bc48/0x6d98ed19b63797d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54b3 expref: 7 pid: 6967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782861.504616:0:6967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0a00, rc 0) 00000100:00080000:0.0:1787782861.504758:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787782861.507942:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312effa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2351:x1874625904572416:12345-192.168.202.15@tcp:101:cat.0 Request processed in 3779us (4397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782861.507962:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:0.0:1787782861.521736:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782861.521814:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904572544 00000100:00100000:1.0:1787782861.521823:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904572544 00002000:00100000:1.0:1787782861.521865:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8c312eff9e00 x1874625904572544/t0(0) o3->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:252/0 lens 488/0 e 0 to 0 dl 1787782872 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787782861.521873:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c312eff9e00 with x1874625904572544 ext(0->4095) 00002000:00010000:1.0:1787782861.521877:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c312eff9e00 00000100:00100000:1.0:1787782861.521902:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:1.0:1787782861.521908:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eff9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2349:x1874625904572544:12345-192.168.202.15@tcp:3:cat.0 00000100:00100000:1.0:1787782861.522500:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eff9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2349:x1874625904572544:12345-192.168.202.15@tcp:3:cat.0 Request processed in 589us (771us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787782861.522510:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00002000:00100000:1.0:1787782861.522518:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8c312eff9e00 x1874625904572544/t0(0) o3->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:252/0 lens 488/4536 e 0 to 0 dl 1787782872 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787782861.522527:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c312eff9e00 with x1874625904572544 ext(0->4095) 00002000:00010000:1.0:1787782861.522530:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c312eff9e00 00010000:00010000:1.0:1787782862.180277:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787782862.534140:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1787782862.534161:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:2.0:1787782863.214738:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782863.462371:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922408960:0@lo:400:kworker.0 00000100:00100000:1.0:1787782863.462438:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782863.462481:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922409472:0@lo:400:kworker.0 00000100:00100000:1.0:1787782863.462517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782863.462545:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782863.462550:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922409088:0@lo:400:kworker.0 00000100:00100000:1.0:1787782863.462567:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782863.462595:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922408960 00000100:00100000:1.0:1787782863.462601:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922408960 00000100:00100000:1.0:1787782863.462635:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922409088 00000100:00100000:1.0:1787782863.462637:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922409088 00000100:00100000:1.0:1787782863.462663:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787782863.462670:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922408960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782863.462712:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922408960:12345-0@lo:400:kworker.0 Request processed in 42us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782863.462718:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787782863.462734:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787782863.462739:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922409088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782863.462759:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922409088:12345-0@lo:400:kworker.0 Request processed in 20us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782863.462764:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787782863.462792:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2ca580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922409088:0@lo:400:kworker.0 00000100:00100000:1.0:1787782863.462801:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2c8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922408960:0@lo:400:kworker.0 00000100:00080000:1.0:1787782863.464858:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782863.464956:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922408832:0@lo:400:kworker.0 00000100:00100000:2.0:1787782863.465033:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782863.465081:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922409344:0@lo:400:kworker.0 00000100:00100000:2.0:1787782863.465130:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782863.465154:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787782863.465160:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922409216:0@lo:400:kworker.0 00000100:00100000:2.0:1787782863.465180:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782863.465206:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922409344 00000100:00100000:2.0:1787782863.465212:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922409344 00000100:00100000:2.0:1787782863.465250:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787782863.465258:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922409344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782863.465300:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922409344:12345-0@lo:400:kworker.0 Request processed in 43us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782863.465307:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787782863.465329:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922409472 00000100:00100000:2.0:1787782863.465332:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922409472 00000100:00100000:2.0:1787782863.465352:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922409216 00000100:00100000:2.0:1787782863.465354:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922409216 00000100:00100000:2.0:1787782863.465371:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787782863.465376:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922409472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782863.465424:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922409472:12345-0@lo:400:kworker.0 Request processed in 47us (2906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782863.465431:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787782863.465442:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787782863.465447:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625922409216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782863.465469:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625922409216:12345-0@lo:400:kworker.0 Request processed in 22us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782863.465474:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787782863.465503:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2cad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922409216:0@lo:400:kworker.0 00000100:00100000:2.0:1787782863.465511:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2c83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922409344:0@lo:400:kworker.0 00000100:00080000:2.0:1787782863.465542:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787782863.465545:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787782863.465547:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782863.465560:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787782863.465565:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1787782863.465578:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c312effbc00, transno 4294967304 00000100:00100000:2.0:1787782863.465588:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2c92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922409472:0@lo:400:kworker.0 00000100:00100000:1.0:1787782863.465705:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922408832 00000100:00100000:1.0:1787782863.465709:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922408832 00000100:00100000:1.0:1787782863.465740:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787782863.465746:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922408832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782863.465780:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922408832:12345-0@lo:400:kworker.0 Request processed in 35us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782863.465791:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787782863.471506:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2cb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922408832:0@lo:400:kworker.0 00000004:00080000:2.0:1787782863.972140:0:6959:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348642041402ns, next at 349642038439ns, rc = 0 00000100:00100000:2.0:1787782863.972186:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31347f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922409600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787782863.972303:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782863.972413:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922409600 00000100:00100000:2.0:1787782863.972421:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922409600 00000100:00100000:2.0:1787782863.972497:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787782863.972506:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f21e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922409600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787782863.972567:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787782863.972615:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f21e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922409600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782863.972622:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787782863.972845:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31347f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922409600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782863.977186:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312effb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922409728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782863.977262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782863.977491:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922409728 00000100:00100000:0.0:1787782863.977499:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922409728 00000100:00100000:0.0:1787782863.977556:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787782863.977568:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922409728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787782863.977607:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782863.977685:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922409728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782863.977694:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787782863.977898:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312effb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922409728:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787782864.225299:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787782864.995252:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787782864.995262:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787782864.995311:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787782864.995318:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1787782865.052295:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:1.0:1787782865.052316:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000004:00080000:1.0:1787782865.052330:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:1.0:1787782865.052342:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1787782865.052349:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c31342f89c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1787782865.052354:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c3108664000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c31342f8b40 00000020:00080000:1.0:1787782865.052358:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c3108664800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c312ecb5800 00000020:00080000:1.0:1787782865.052383:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:1.0:1787782865.052451:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922409856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787782865.052516:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782865.052586:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922409856 00000100:00100000:1.0:1787782865.052591:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922409856 00000100:00100000:1.0:1787782865.052641:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787782865.052650:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625922409856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787782865.052861:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787782865.052865:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787782858 -> 1787782858 00002000:00010000:1.0:1787782865.052867:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1787782858 -> 1787782858 00002000:00010000:1.0:1787782865.052942:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787782858 -> 1787782858 00002000:00010000:1.0:1787782865.052946:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787782865.052998:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1874625922409856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 348us (481us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787782865.053006:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1787782865.053028:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787782865.053058:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c312f2ca940/2, rc 0, transno 4294967312 00000100:00100000:1.0:1787782865.053064:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2ca940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922409856:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1787782865.056356:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1787782865.056569:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1787782865.117188:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1787782865.117274:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:1.0:1787782865.263188:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782865.419720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782865.419808:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782865.419849:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782865.419885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782865.419932:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782865.419977:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904572800 00000100:00100000:1.0:1787782865.419986:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904572800 00000100:00100000:1.0:1787782865.420052:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904573184 00000100:00100000:1.0:1787782865.420055:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904573184 00000100:00100000:1.0:1787782865.420079:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 154 00000100:00100000:1.0:1787782865.420089:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+13:2351:x1874625904572800:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782865.420219:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+13:2351:x1874625904572800:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 130us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782865.420227:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 154 00000100:00100000:1.0:1787782865.420247:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 155 00000100:00100000:1.0:1787782865.420253:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2352:x1874625904573184:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782865.420278:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2352:x1874625904573184:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 26us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782865.420299:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 155 00000100:00100000:1.0:1787782865.420319:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904572928 00000100:00100000:1.0:1787782865.420323:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904572928 00000100:00100000:1.0:1787782865.420348:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904573056 00000100:00100000:1.0:1787782865.420351:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904573056 00000100:00100000:1.0:1787782865.420371:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:1.0:1787782865.420378:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2352:x1874625904572928:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782865.420407:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2352:x1874625904572928:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 29us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782865.420414:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:1.0:1787782865.420425:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 89 00000100:00100000:1.0:1787782865.420431:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2ca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2351:x1874625904573056:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782865.420453:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2ca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2351:x1874625904573056:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 22us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782865.420459:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 89 00000100:00080000:1.0:1787782865.420489:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787782865.420494:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782865.420497:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782865.421594:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904572672 00000100:00100000:3.0:1787782865.421603:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904572672 00000100:00100000:3.0:1787782865.421697:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 297 00000100:00100000:3.0:1787782865.421707:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2352:x1874625904572672:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782865.421765:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2352:x1874625904572672:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 60us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782865.421773:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 297 00010000:00010000:0.0:1787782866.276158:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782867.297358:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782867.343454:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782867.343558:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904573312 00000100:00100000:2.0:1787782867.343569:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904573312 00000100:00100000:2.0:1787782867.343683:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 135 00000100:00100000:2.0:1787782867.343694:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eed83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+13:10237:x1874625904573312:12345-192.168.202.15@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787782867.343803:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eed83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+13:10237:x1874625904573312:12345-192.168.202.15@tcp:60:lhsmtool_posix.0 Request processed in 111us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782867.343812:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 135 00000100:00080000:1.0:1787782867.345442:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782867.351223:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782867.351364:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904573568 00000100:00100000:1.0:1787782867.351373:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904573568 00000100:00100000:1.0:1787782867.351433:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:1.0:1787782867.351441:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+13:10237:x1874625904573568:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787782867.351912:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+14:10237:x1874625904573568:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 470us (696us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787782867.351926:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:0.0:1787782867.808781:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782867.808914:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904573696 00000100:00100000:3.0:1787782867.808923:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904573696 00000100:00100000:3.0:1787782867.809033:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 136 00000100:00100000:3.0:1787782867.809045:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eff8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:11037:x1874625904573696:12345-192.168.202.15@tcp:101:lsof.0 00010000:00010000:3.0:1787782867.809067:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782867.809171:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637984 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e54ba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782867.809263:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63798b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782867.809276:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63798b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782867.809288:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63798b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782867.809470:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787782867.809475:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787782867.809566:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63798b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782867.809591:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637984 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54ba expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782867.809607:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63798b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54ba expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782867.809614:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3108738800) 00010000:00010000:3.0:1787782867.809617:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787782867.809621:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1e00, rc 0) 00000100:00100000:3.0:1787782867.809674:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eff8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:11037:x1874625904573696:12345-192.168.202.15@tcp:101:lsof.0 Request processed in 632us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782867.809682:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 136 00000100:00080000:0.0:1787782867.811404:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787782868.323561:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782868.577982:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922410112:0@lo:400:kworker.0 00000100:00100000:3.0:1787782868.578054:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782868.578155:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31187a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922410624:0@lo:400:kworker.0 00000100:00100000:3.0:1787782868.578181:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782868.578209:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787782868.578213:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31347f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922409984:0@lo:400:kworker.0 00000100:00100000:3.0:1787782868.578239:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782868.578259:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922410496:0@lo:400:kworker.0 00000100:00100000:3.0:1787782868.578277:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782868.578300:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922409984 00000100:00100000:3.0:1787782868.578306:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922409984 00000100:00100000:3.0:1787782868.578647:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787782868.578656:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922409984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782868.578702:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3307:x1874625922409984:12345-0@lo:400:kworker.0 Request processed in 47us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782868.578709:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787782868.578740:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922410112 00000100:00100000:3.0:1787782868.578743:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922410112 00000100:00100000:3.0:1787782868.578769:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922410496 00000100:00100000:3.0:1787782868.578772:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922410496 00000100:00100000:3.0:1787782868.578798:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787782868.578803:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922410112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782868.578830:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922410112:12345-0@lo:400:kworker.0 Request processed in 27us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782868.578836:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787782868.578846:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787782868.578852:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922410496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782868.578872:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922410496:12345-0@lo:400:kworker.0 Request processed in 21us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782868.578884:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787782868.578919:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31347f4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922409984:0@lo:400:kworker.0 00000100:00100000:3.0:1787782868.578943:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922410496:0@lo:400:kworker.0 00000100:00100000:3.0:1787782868.578953:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922410112:0@lo:400:kworker.0 00000100:00100000:1.0:1787782868.579042:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922410240:0@lo:400:kworker.0 00000100:00100000:1.0:1787782868.579082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782868.579126:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782868.579132:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922410368:0@lo:400:kworker.0 00000100:00100000:1.0:1787782868.579156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782868.579182:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922410624 00000100:00100000:1.0:1787782868.579186:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922410624 00000100:00100000:1.0:1787782868.579210:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922410368 00000100:00100000:1.0:1787782868.579212:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922410368 00000100:00100000:1.0:1787782868.579229:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787782868.579235:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922410624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782868.579267:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922410624:12345-0@lo:400:kworker.0 Request processed in 32us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782868.579272:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787782868.579283:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787782868.579288:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625922410368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782868.579313:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625922410368:12345-0@lo:400:kworker.0 Request processed in 25us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782868.579318:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787782868.579348:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1787782868.579353:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:1.0:1787782868.579368:0:3304:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8c312f2ca940 x1874625922409856/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787782881 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782868.579378:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922410368:0@lo:400:kworker.0 00000100:00100000:1.0:1787782868.579404:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31187a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922410624:0@lo:400:kworker.0 00000100:00100000:2.0:1787782868.579518:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922410240 00000100:00100000:2.0:1787782868.579525:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922410240 00000100:00100000:2.0:1787782868.579565:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787782868.579571:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eedb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922410240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782868.579607:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eedb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922410240:12345-0@lo:400:kworker.0 Request processed in 37us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782868.579613:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:0.0:1787782868.579682:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787782868.579691:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787782868.579694:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782868.580393:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119ef6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922410240:0@lo:400:kworker.0 00000100:00100000:1.0:1787782869.089616:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eff8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922410752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782869.089688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782869.089839:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922410752 00000100:00100000:3.0:1787782869.089847:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922410752 00000100:00100000:3.0:1787782869.089894:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787782869.089903:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922410752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787782869.089949:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782869.090006:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922410752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782869.090012:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787782869.090148:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eff8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922410752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787782869.090870:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3108269e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922410880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787782869.090909:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782869.091086:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922410880 00000100:00100000:1.0:1787782869.091220:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922410880 00000100:00100000:1.0:1787782869.091258:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787782869.091265:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31187a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625922410880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782869.091291:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782869.091333:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31187a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625922410880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782869.091340:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787782869.091578:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3108269e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922410880:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787782869.345542:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787782870.172411:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1787782870.198405:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1787782870.198505:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1787782870.198546:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787782870.198556:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787782870.369508:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782870.540471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782870.540520:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782870.540607:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782870.540641:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782870.540691:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904573824 00000100:00100000:2.0:1787782870.540700:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904573824 00000100:00100000:2.0:1787782870.540756:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 299 00000100:00100000:2.0:1787782870.540765:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2350:x1874625904573824:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782870.540834:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2350:x1874625904573824:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 70us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782870.540842:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 299 00000100:00100000:3.0:1787782870.543076:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904573952 00000100:00100000:3.0:1787782870.543088:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904573952 00000100:00100000:3.0:1787782870.543196:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 159 00000100:00100000:3.0:1787782870.543206:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312effa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+13:2350:x1874625904573952:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782870.543275:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312effa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+13:2350:x1874625904573952:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 72us (2815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782870.543283:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 159 00000100:00080000:2.0:1787782870.547887:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782870.548560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782870.548663:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904574336 00000100:00100000:3.0:1787782870.548672:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904574336 00000100:00100000:3.0:1787782870.548735:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 160 00000100:00100000:3.0:1787782870.548744:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312effb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:2350:x1874625904574336:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782870.548834:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312effb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:2350:x1874625904574336:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 91us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782870.548842:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 160 00000100:00080000:0.0:1787782870.561710:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782870.565871:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904574208 00000100:00100000:1.0:1787782870.565887:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904574208 00000100:00100000:1.0:1787782870.565987:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904574080 00000100:00100000:1.0:1787782870.565990:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904574080 00000100:00100000:1.0:1787782870.566021:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:1.0:1787782870.566031:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312effad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2350:x1874625904574208:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782870.566129:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312effad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2350:x1874625904574208:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 98us (25607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782870.566137:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:1.0:1787782870.566156:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 93 00000100:00100000:1.0:1787782870.566162:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eff8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904574080:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782870.566202:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eff8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904574080:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 41us (25561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782870.566209:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 93 00000100:00080000:1.0:1787782870.566340:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782870.566344:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787782871.393432:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782872.418113:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787782872.914741:0:12319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 18:21:11 (1787782871) 00010000:00010000:0.0:1787782873.441554:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782873.697377:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f38b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922411008:0@lo:400:kworker.0 00000100:00100000:0.0:1787782873.697455:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782873.697666:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f389e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922411136:0@lo:400:kworker.0 00000100:00100000:3.0:1787782873.697699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782873.697740:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922411136 00000100:00100000:3.0:1787782873.697748:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922411136 00000100:00100000:1.0:1787782873.697750:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922411008 00000100:00100000:1.0:1787782873.697753:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922411008 00000100:00100000:1.0:1787782873.697788:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787782873.697789:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787782873.697797:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922411136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782873.697797:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922411008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782873.697875:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922411136:12345-0@lo:400:kworker.0 Request processed in 79us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782873.697891:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787782873.697942:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f389e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922411136:0@lo:400:kworker.0 00000100:00100000:1.0:1787782873.698067:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922411008:12345-0@lo:400:kworker.0 Request processed in 270us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782873.698074:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787782873.698155:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f389a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922411392:0@lo:400:kworker.0 00000100:00100000:2.0:1787782873.698187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782873.698211:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787782873.698216:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625922411264:0@lo:400:kworker.0 00000100:00100000:2.0:1787782873.698239:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782873.698272:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922411392 00000100:00100000:2.0:1787782873.698276:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922411392 00000100:00100000:2.0:1787782873.698313:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787782873.698320:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922411392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782873.698353:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922411392:12345-0@lo:400:kworker.0 Request processed in 34us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782873.698359:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787782873.698396:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1787782873.698401:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c312f2ca940, transno 4294967312 00000100:00100000:2.0:1787782873.698412:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f389a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922411392:0@lo:400:kworker.0 00000100:00080000:2.0:1787782873.698441:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787782873.698849:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922411264 00000100:00100000:3.0:1787782873.698854:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922411264 00000100:00100000:3.0:1787782873.698903:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787782873.698911:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625922411264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782873.698954:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625922411264:12345-0@lo:400:kworker.0 Request processed in 44us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782873.698960:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787782873.698994:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625922411264:0@lo:400:kworker.0 00000100:00100000:3.0:1787782873.699012:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31345fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922411648:0@lo:400:kworker.0 00000100:00100000:3.0:1787782873.699038:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782873.699059:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787782873.699064:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f389e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922411520:0@lo:400:kworker.0 00000100:00100000:3.0:1787782873.699126:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782873.699150:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922411520 00000100:00100000:3.0:1787782873.699154:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922411520 00000100:00100000:3.0:1787782873.699180:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787782873.699186:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922411520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782873.699220:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922411520:12345-0@lo:400:kworker.0 Request processed in 35us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782873.699227:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787782873.699255:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f389e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922411520:0@lo:400:kworker.0 00000100:00100000:3.0:1787782873.699283:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922411648 00000100:00100000:3.0:1787782873.699286:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922411648 00000100:00100000:3.0:1787782873.699314:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787782873.699321:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922411648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782873.699355:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922411648:12345-0@lo:400:kworker.0 Request processed in 35us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782873.699360:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787782873.699386:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31345fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922411648:0@lo:400:kworker.0 00000100:00080000:2.0:1787782873.699591:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787782873.699596:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782873.699780:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f38b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922411008:0@lo:400:kworker.0 00000040:00080000:2.0:1787782874.209384:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787782874.209394:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787782874.209801:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1787782874.209813:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787782874.211366:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3108268b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922411776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782874.211445:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782874.211525:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787782874.211532:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312effbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922411904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782874.211555:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782874.211675:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922411776 00000100:00100000:0.0:1787782874.211682:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922411776 00000100:00100000:0.0:1787782874.211720:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922411904 00000100:00100000:0.0:1787782874.211723:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922411904 00000100:00100000:0.0:1787782874.211737:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787782874.211747:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922411776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787782874.211778:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782874.211822:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922411776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782874.211830:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787782874.211844:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787782874.211861:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922411904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787782874.211891:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782874.211917:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922411904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782874.211923:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787782874.212087:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312effbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922411904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782874.212134:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3108268b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922411776:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787782874.465417:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782875.490497:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782875.662191:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782875.662237:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782875.662271:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782875.662308:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782875.662339:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782875.662370:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904574976 00000100:00100000:0.0:1787782875.662380:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904574976 00000100:00100000:0.0:1787782875.662437:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904574592 00000100:00100000:0.0:1787782875.662440:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904574592 00000100:00100000:0.0:1787782875.662461:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 164 00000100:00100000:0.0:1787782875.662469:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312effbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:2350:x1874625904574976:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782875.662548:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312effbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:2350:x1874625904574976:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 80us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782875.662556:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 164 00000100:00100000:0.0:1787782875.662572:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 165 00000100:00100000:0.0:1787782875.662579:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312effb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+13:2350:x1874625904574592:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782875.662600:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312effb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+13:2350:x1874625904574592:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 23us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782875.662606:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 165 00000100:00100000:0.0:1787782875.662621:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904574720 00000100:00100000:0.0:1787782875.662636:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904574720 00000100:00100000:0.0:1787782875.662661:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904574848 00000100:00100000:0.0:1787782875.662663:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904574848 00000100:00100000:0.0:1787782875.662680:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 96 00000100:00100000:0.0:1787782875.662686:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eff92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904574720:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782875.662714:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eff92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904574720:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 29us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782875.662719:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 96 00000100:00100000:0.0:1787782875.662727:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00100000:0.0:1787782875.662733:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2350:x1874625904574848:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782875.662752:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2350:x1874625904574848:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 19us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782875.662757:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00080000:0.0:1787782875.662772:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787782875.662776:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787782875.662779:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782875.663183:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904574464 00000100:00100000:3.0:1787782875.663194:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904574464 00000100:00100000:3.0:1787782875.663231:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 301 00000100:00100000:3.0:1787782875.663239:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2350:x1874625904574464:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782875.663280:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2350:x1874625904574464:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 42us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782875.663287:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 301 00000100:00100000:0.0:1787782875.806294:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782875.806469:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904575232 00000100:00100000:3.0:1787782875.806479:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904575232 00000100:00100000:3.0:1787782875.806540:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 137 00000100:00100000:3.0:1787782875.806561:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+13:11302:x1874625904575232:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787782875.806583:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782875.806604:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637992 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e54c1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.806679:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637999 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.806693:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637999 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.806706:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637999 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.806774:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6379a0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.806783:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6379a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.806789:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6379a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.807610:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6379a7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.808343:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6379a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.808430:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6379a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782875.808444:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787782875.808988:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637999 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.808998:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637999 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.809005:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637999 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.809011:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782875.809015:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637999 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.809022:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637999 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.809035:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c3104d6ef00) 00010000:00010000:3.0:1787782875.809038:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782875.809043:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637999 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.809048:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637999 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.809081:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6379a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.809087:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6379a0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.809210:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6379a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.809219:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782875.809222:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6379a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.809229:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6379a0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.809238:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c3104d6e500) 00010000:00010000:3.0:1787782875.809241:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782875.809244:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6379a0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.809249:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b6379a0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.810057:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637992 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54c1 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.810081:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6379a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54c1 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782875.810133:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c312eeef700) 00010000:00010000:3.0:1787782875.810136:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782875.810139:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0000, rc 0) 00000100:00100000:3.0:1787782875.810263:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+15:11302:x1874625904575232:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 3712us (3979us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787782875.810273:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 137 00000100:00100000:0.0:1787782875.822804:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782875.823126:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904575360 00000100:00100000:2.0:1787782875.823137:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904575360 00000100:00100000:2.0:1787782875.823202:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:2.0:1787782875.823212:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+15:2349:x1874625904575360:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782875.823229:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782875.823255:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b6379a7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54c1 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782875.823275:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c312eeef700) 00010000:00010000:2.0:1787782875.823280:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782875.823335:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+14:2349:x1874625904575360:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 125us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782875.823343:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:0.0:1787782875.827427:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782875.827588:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904575488 00000100:00100000:3.0:1787782875.827601:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904575488 00000100:00100000:3.0:1787782875.827664:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 138 00000100:00100000:3.0:1787782875.827675:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+14:11302:x1874625904575488:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787782875.827809:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+14:11302:x1874625904575488:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 Request processed in 136us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782875.827816:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 138 00000040:00080000:3.0:1787782876.261915:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787782876.261924:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787782876.263045:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787782876.263058:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787782876.530960:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782877.539758:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782878.303125:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782878.303358:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904575616 00000100:00100000:0.0:1787782878.303369:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904575616 00000100:00100000:0.0:1787782878.303435:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 139 00000100:00100000:0.0:1787782878.303446:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+14:11345:x1874625904575616:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787782878.303466:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782878.303486:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e54c8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.303572:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6379bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.303587:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6379bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.303599:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6379bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.303613:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b6379c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.303620:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b6379c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.303626:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b6379c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304310:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6379bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304319:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6379bc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304325:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6379bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304331:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782878.304335:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6379bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304351:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6379bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304364:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3108738800) 00010000:00010000:0.0:1787782878.304367:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782878.304372:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6379bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304378:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b6379bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304390:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b6379c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304396:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b6379c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304402:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b6379c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304407:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782878.304409:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b6379c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304414:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b6379c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304420:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c310823c700) 00010000:00010000:0.0:1787782878.304423:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782878.304425:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b6379c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304440:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b6379c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304474:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379b5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54c8 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304483:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3108738800) 00010000:00010000:0.0:1787782878.304485:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782878.304488:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54c8 expref: 15 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.304498:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254400, rc 0) 00000100:00080000:2.0:1787782878.304678:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782878.304721:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+14:11345:x1874625904575616:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1277us (1604us total) trans 0 rc 301/301 00000100:00100000:0.0:1787782878.304730:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 139 00000100:00100000:1.0:1787782878.320743:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782878.320941:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904575872 00000100:00100000:0.0:1787782878.321346:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904575872 00000100:00100000:0.0:1787782878.321424:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 140 00000100:00100000:0.0:1787782878.321435:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31082683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+14:11345:x1874625904575872:12345-192.168.202.15@tcp:36:lfs.0 00010000:00010000:0.0:1787782878.321973:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782878.322008:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295a00/0x6d98ed19b637333 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5301 expref: 14 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.322027:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3108738800) 00010000:00010000:0.0:1787782878.322031:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787782878.322483:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379ca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.323333:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63798b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54ba expref: 5 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.323347:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379ca lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.323389:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63798b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54ba expref: 5 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.323404:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63798b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54ba expref: 5 pid: 5851 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782878.323417:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922412032:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787782878.323558:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107fe3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787782878.332649:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782878.333369:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8bc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922412032:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782878.333398:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379ca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782878.333561:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904576000 00000100:00100000:2.0:1787782878.333568:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904576000 00010000:00010000:2.0:1787782878.333624:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63798b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54ba expref: 6 pid: 5851 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782878.333656:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:2.0:1787782878.333664:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:2349:x1874625904576000:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782878.333679:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782878.333685:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63798b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54ba expref: 6 pid: 5851 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.333723:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63798b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54ba expref: 6 pid: 5851 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.333747:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b63798b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54ba expref: 6 pid: 5851 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.333762:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3108738800) 00010000:00010000:2.0:1787782878.333767:0:7637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379ca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.333927:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.333935:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379ca lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.334281:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782878.334336:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2349:x1874625904576000:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 671us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782878.334344:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 61 00010000:00010000:2.0:1787782878.334459:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.334466:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.334488:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b6379d1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.334519:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b6379d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.334527:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b6379d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787782878.335439:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1787782878.342953:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787782878.342974:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379ca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.342984:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379ca lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.342991:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379ca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.342996:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782878.343001:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379ca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.343007:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379ca lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.343023:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c3108738800) 00010000:00010000:2.0:1787782878.343027:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782878.343031:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379ca lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.343037:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b6379ca lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787782878.343314:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097870996 reply state 000000001486a774 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b6379d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782878.343333:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787782878.343442:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31082683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+15:11345:x1874625904575872:12345-192.168.202.15@tcp:36:lfs.0 Request processed in 22004us (22704us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787782878.343451:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 140 00010000:00010000:3.0:1787782878.347445:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b6379d1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782878.347465:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b6379d1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782878.347472:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b6379d1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782878.347493:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782878.347498:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b6379d1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782878.347506:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b6379d1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782878.347524:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c3108738000) 00010000:00010000:3.0:1787782878.347528:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782878.347533:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b6379d1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782878.347539:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b6379d1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782878.493764:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782878.493930:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904576128 00000100:00100000:1.0:1787782878.493940:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904576128 00000100:00100000:1.0:1787782878.494000:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 141 00000100:00100000:1.0:1787782878.494020:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+14:11353:x1874625904576128:12345-192.168.202.15@tcp:101:lctl.0 00010000:00010000:1.0:1787782878.494044:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782878.494081:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b6379d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e54cf expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.494254:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204a00/0x6d98ed19b6379df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.494270:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204a00/0x6d98ed19b6379df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.494281:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204a00/0x6d98ed19b6379df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782878.494347:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787782878.494351:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782878.494377:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204a00/0x6d98ed19b6379df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.494402:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b6379d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54cf expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.494419:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204a00/0x6d98ed19b6379df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54cf expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.494426:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312eeef200) 00010000:00010000:2.0:1787782878.494430:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787782878.494433:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204a00, rc 0) 00000100:00100000:2.0:1787782878.494496:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+15:11353:x1874625904576128:12345-192.168.202.15@tcp:101:lctl.0 Request processed in 488us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782878.494510:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 141 00010000:00010000:0.0:1787782878.562927:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782878.567812:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782878.568512:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904576256 00000100:00100000:1.0:1787782878.568521:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904576256 00000100:00100000:1.0:1787782878.568576:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 142 00000100:00100000:1.0:1787782878.568584:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+15:11359:x1874625904576256:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787782878.568601:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782878.568619:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b6379e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e54d6 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.568672:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b6379ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.568683:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b6379ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.568691:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b6379ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.568701:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b6379f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.568705:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b6379f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.568709:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b6379f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.568850:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6379fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.568873:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6379fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.568878:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6379fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782878.569178:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787782878.569182:0:6719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787782878.569211:0:6719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6379fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569224:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b6379ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569228:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b6379ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569233:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b6379ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569236:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782878.569239:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b6379ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569244:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b6379ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569252:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312eeef200) 00010000:00010000:1.0:1787782878.569254:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782878.569257:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b6379ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569269:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b6379ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569279:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b6379f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569283:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b6379f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569286:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b6379f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569289:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782878.569291:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b6379f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569294:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b6379f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569298:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c312eeef500) 00010000:00010000:1.0:1787782878.569299:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782878.569301:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b6379f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569304:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b6379f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569325:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b6379e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54d6 expref: 17 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569333:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6379fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54d6 expref: 16 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.569342:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782878.569344:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787782878.569345:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7e00, rc 0) 00000100:00100000:1.0:1787782878.569407:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+16:11359:x1874625904576256:12345-192.168.202.15@tcp:101:bash.0 Request processed in 822us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782878.569414:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 142 00000100:00100000:3.0:1787782878.574697:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782878.574799:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904576512 00000100:00100000:0.0:1787782878.574808:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904576512 00000100:00100000:0.0:1787782878.575746:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 143 00000100:00100000:0.0:1787782878.575764:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+16:11359:x1874625904576512:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787782878.575782:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782878.575798:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637a02 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e54dd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.575946:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637a09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.575960:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637a09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.575985:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637a09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.576039:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637a10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.576047:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.576054:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787782878.576608:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1787782878.576754:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637a17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.576761:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637a17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.576766:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637a17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.576791:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637a09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.576796:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637a09 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.576801:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637a09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.576804:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782878.576813:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637a09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.576818:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637a09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.576827:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:0.0:1787782878.576829:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782878.576832:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637a09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.576850:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637a09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787782878.576859:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f75e524 reply state 00000000a6929d8b transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782878.576865:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787782878.576888:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637a02 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54dd expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.576896:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637a17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54dd expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.576901:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c200) 00010000:00010000:0.0:1787782878.576903:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787782878.576905:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254200, rc 0) 00000100:00100000:0.0:1787782878.576967:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+19:11359:x1874625904576512:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1207us (2279us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787782878.576975:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 143 00010000:00010000:0.0:1787782878.579516:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.579533:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637a10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.579540:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637a10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.579546:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782878.579550:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637a10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.579557:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637a10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.579572:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c310823c700) 00010000:00010000:0.0:1787782878.579575:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782878.579579:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637a10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.579585:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637a10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782878.581939:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782878.582015:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904576640 00000100:00100000:0.0:1787782878.582026:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904576640 00000100:00100000:0.0:1787782878.582168:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:0.0:1787782878.582179:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2350:x1874625904576640:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787782878.582197:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782878.582218:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637a25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e54e4 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787782878.582263:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787782878.582283:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1787782878.582288:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782878.582298:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637a25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54e4 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.582318:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637a25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54e4 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.582331:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254600, rc 0) 00000100:00100000:0.0:1787782878.582397:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904576640:12345-192.168.202.15@tcp:101:bash.0 Request processed in 220us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782878.582404:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00080000:3.0:1787782878.582636:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787782878.585518:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782878.585600:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904576768 00000100:00100000:0.0:1787782878.585610:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904576768 00000100:00100000:0.0:1787782878.585669:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:0.0:1787782878.585679:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f38b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:11359:x1874625904576768:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787782878.585696:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782878.585715:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e54eb expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.585749:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637a25 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54e4 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.585759:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782878.585775:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782878.585781:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54eb expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.585815:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637a25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54e4 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.585828:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637a25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54e4 expref: 7 pid: 6698 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782878.585857:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874625922412160:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787782878.585953:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107fe3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782878.587723:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8bc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874625922412160:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787782878.587756:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54eb expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.587775:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255c00, rc 0) 00000100:00100000:0.0:1787782878.587828:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f38b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+7:11359:x1874625904576768:12345-192.168.202.15@tcp:101:bash.0 Request processed in 2149us (2320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782878.587849:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:2.0:1787782878.591200:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782878.591297:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904576896 00000100:00100000:0.0:1787782878.591307:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904576896 00010000:00010000:0.0:1787782878.591345:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637a25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54e4 expref: 7 pid: 6698 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782878.591380:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:0.0:1787782878.591413:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f389e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2349:x1874625904576896:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782878.591432:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782878.591457:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637a25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54e4 expref: 7 pid: 6698 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.591470:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637a25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54e4 expref: 7 pid: 6698 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.591493:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1c40607/0x6d98ed19b637a25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54e4 expref: 7 pid: 6698 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.591508:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782878.591513:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782878.591521:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54eb expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.591532:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54eb expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.591566:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54eb expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782878.591581:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119e8bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1874625922412288:192.168.202.15@tcp:105: 00000100:00100000:0.0:1787782878.591701:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107fe3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787782878.595990:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782878.596086:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904577152 00000100:00100000:1.0:1787782878.596112:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904577152 00000100:00100000:0.0:1787782878.596141:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119e8bc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1874625922412288:192.168.202.15@tcp:105: 00000100:00100000:1.0:1787782878.596172:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00010000:00010000:0.0:1787782878.596179:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782878.596180:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+18:11359:x1874625904577152:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:0.0:1787782878.596223:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f389e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904576896:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 4820us (5032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782878.596231:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:1.0:1787782878.596489:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+19:11359:x1874625904577152:12345-192.168.202.15@tcp:35:bash.0 Request processed in 309us (507us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787782878.596497:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:2.0:1787782878.702497:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782878.702649:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904577408 00000100:00100000:1.0:1787782878.702658:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904577408 00000100:00100000:1.0:1787782878.702709:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 144 00000100:00100000:1.0:1787782878.702716:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f389a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+19:11369:x1874625904577408:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787782878.702738:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782878.702755:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637a33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e54f2 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782878.702868:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787782878.702959:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637a33 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54f2 expref: 21 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.702985:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312eeef200) 00010000:00010000:1.0:1787782878.702988:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787782878.702991:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637a33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54f2 expref: 21 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.703002:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6c00, rc 0) 00000100:00100000:1.0:1787782878.703070:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f389a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+20:11369:x1874625904577408:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 353us (582us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1787782878.703077:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 144 00000100:00100000:2.0:1787782878.710356:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782878.710657:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904577664 00000100:00100000:0.0:1787782878.710667:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904577664 00000100:00100000:0.0:1787782878.710728:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:0.0:1787782878.710739:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+20:11369:x1874625904577664:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787782878.712617:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+21:11369:x1874625904577664:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 1871us (2262us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787782878.712630:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:0.0:1787782878.818207:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922412416:0@lo:400:kworker.0 00000100:00100000:2.0:1787782878.818211:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922412800:0@lo:400:kworker.0 00000100:00100000:1.0:1787782878.818283:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922412544:0@lo:400:kworker.0 00000100:00100000:3.0:1787782878.818289:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922412672:0@lo:400:kworker.0 00000100:00100000:1.0:1787782878.821398:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782878.821469:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922413056:0@lo:400:kworker.0 00000100:00100000:2.0:1787782878.821542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782878.821627:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922412544 00000100:00100000:2.0:1787782878.821637:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922412544 00000100:00100000:2.0:1787782878.821686:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787782878.821695:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310826a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922412544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782878.821815:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310826a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922412544:12345-0@lo:400:kworker.0 Request processed in 116us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782878.821822:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787782878.821871:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922412800 00000100:00100000:2.0:1787782878.821875:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922412800 00000100:00100000:2.0:1787782878.821909:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787782878.821916:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922412800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782878.821966:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922412800:12345-0@lo:400:kworker.0 Request processed in 50us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782878.821971:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787782878.822005:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922412800:0@lo:400:kworker.0 00000100:00080000:2.0:1787782878.822035:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782878.822366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782878.822450:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922412544:0@lo:400:kworker.0 00000100:00100000:2.0:1787782878.822549:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922413056 00000100:00100000:2.0:1787782878.822554:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922413056 00000100:00100000:2.0:1787782878.822636:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787782878.822643:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108268780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922413056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782878.822682:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108268780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922413056:12345-0@lo:400:kworker.0 Request processed in 40us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782878.822688:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1787782878.822741:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787782878.822762:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922413056:0@lo:400:kworker.0 00000100:00100000:3.0:1787782878.823250:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782878.823331:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922412672 00000100:00100000:1.0:1787782878.823336:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922412672 00000100:00100000:1.0:1787782878.823419:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787782878.823427:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922412672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782878.823468:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922412672:12345-0@lo:400:kworker.0 Request processed in 42us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782878.823474:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787782878.823607:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782878.823641:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922412928:0@lo:400:kworker.0 00000100:00100000:0.0:1787782878.823663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782878.823690:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922412928 00000100:00100000:0.0:1787782878.823693:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922412928 00000100:00100000:3.0:1787782878.823752:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922412672:0@lo:400:kworker.0 00000100:00100000:1.0:1787782878.823807:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922412416 00000100:00100000:1.0:1787782878.823820:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922412416 00000100:00100000:1.0:1787782878.823859:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787782878.823866:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109134c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922412416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782878.823909:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109134c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922412416:12345-0@lo:400:kworker.0 Request processed in 33us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782878.823915:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787782878.823957:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922412416:0@lo:400:kworker.0 00000100:00080000:2.0:1787782878.824154:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782878.824274:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787782878.824280:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119e8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922412928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782878.824321:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119e8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922412928:12345-0@lo:400:kworker.0 Request processed in 42us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782878.824327:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787782878.824386:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922412928:0@lo:400:kworker.0 00000100:00100000:2.0:1787782878.864720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782878.865332:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904577792 00000100:00100000:1.0:1787782878.865343:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904577792 00000100:00100000:1.0:1787782878.865405:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 145 00000100:00100000:1.0:1787782878.865415:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+21:11375:x1874625904577792:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787782878.865436:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782878.865456:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637a41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e54f9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.865534:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637a48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.865549:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.865560:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782878.865619:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787782878.865623:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787782878.865646:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.865690:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637a41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54f9 expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.865720:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54f9 expref: 22 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.865728:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782878.865731:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787782878.865734:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7200, rc 0) 00000100:00100000:1.0:1787782878.865979:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+22:11375:x1874625904577792:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 564us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782878.865986:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 145 00000100:00100000:2.0:1787782878.873517:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782878.873725:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904578048 00000100:00100000:0.0:1787782878.873734:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904578048 00000100:00100000:0.0:1787782878.873803:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 146 00000100:00100000:0.0:1787782878.873813:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+22:11375:x1874625904578048:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787782878.873860:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782878.873883:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637a4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5500 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.873984:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637a56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.873999:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.874012:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782878.874023:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787782878.874211:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637a4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5500 expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.874230:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637a56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5500 expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.874239:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c200) 00010000:00010000:0.0:1787782878.874243:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787782878.874246:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254e00, rc 0) 00000100:00100000:0.0:1787782878.874293:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+24:11375:x1874625904578048:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 482us (796us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787782878.874301:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 146 00000100:00100000:2.0:1787782878.880002:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782878.880046:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782878.880127:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904578432 00000100:00100000:0.0:1787782878.880135:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904578432 00000100:00100000:0.0:1787782878.880204:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:0.0:1787782878.880226:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+24:2349:x1874625904578432:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782878.880242:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782878.880266:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637a56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5500 expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.880283:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c200) 00010000:00010000:0.0:1787782878.880288:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782878.880348:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+23:2349:x1874625904578432:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 123us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782878.880356:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:1.0:1787782878.880890:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904578304 00000100:00100000:1.0:1787782878.880895:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904578304 00000100:00100000:1.0:1787782878.880927:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 147 00000100:00100000:1.0:1787782878.880935:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+23:11375:x1874625904578304:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787782878.880954:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782878.880969:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637a64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5507 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.881067:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637a6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.881080:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637a6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.881090:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637a6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782878.881128:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787782878.881382:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637a64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5507 expref: 26 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.881397:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637a6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5507 expref: 25 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.881404:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c200) 00010000:00010000:1.0:1787782878.881407:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787782878.881410:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7000, rc 0) 00000100:00100000:1.0:1787782878.881445:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+25:11375:x1874625904578304:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 511us (1453us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1787782878.881451:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 147 00000100:00100000:2.0:1787782878.895151:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782878.895345:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904578560 00000100:00100000:0.0:1787782878.895354:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904578560 00000100:00100000:0.0:1787782878.895409:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:0.0:1787782878.895418:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904578560:12345-192.168.202.15@tcp:1:lfs.0 00010000:00010000:0.0:1787782878.895460:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000705c0ed4/0x6d98ed19b637a79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.895480:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54eb expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.895487:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782878.895491:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787782878.895495:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000705c0ed4/0x6d98ed19b637a79 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.895530:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54eb expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.895559:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54eb expref: 6 pid: 6697 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782878.895633:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f134780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874625922413184:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787782878.895731:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106d8d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787782878.901764:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782878.905516:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904578688 00000100:00100000:2.0:1787782878.905531:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904578688 00002000:00100000:2.0:1787782878.905591:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8c3108269a40 x1874625904578688/t0(0) o4->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:269/0 lens 504/0 e 0 to 0 dl 1787782889 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787782878.905603:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c3108269a40 with x1874625904578688 ext(0->12) 00010000:00010000:2.0:1787782878.905613:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54eb expref: 7 pid: 6697 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.905630:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54eb expref: 7 pid: 6697 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787782878.905638:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c3108269a40 00000100:00100000:2.0:1787782878.905680:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:2.0:1787782878.905689:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108269a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2350:x1874625904578688:12345-192.168.202.15@tcp:4:lfs.0 00000100:00100000:2.0:1787782878.906311:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108269a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2350:x1874625904578688:12345-192.168.202.15@tcp:4:lfs.0 Request processed in 622us (4557us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787782878.906320:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00002000:00100000:2.0:1787782878.906327:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8c3108269a40 x1874625904578688/t4294967305(0) o4->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:269/0 lens 504/448 e 0 to 0 dl 1787782889 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787782878.906335:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c3108269a40 with x1874625904578688 ext(0->12) 00010000:00010000:2.0:1787782878.906341:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54eb expref: 9 pid: 6697 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.906352:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54eb expref: 9 pid: 6697 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787782878.906359:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c3108269a40 00000100:00100000:0.0:1787782878.907745:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f134780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874625922413184:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787782878.907771:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000705c0ed4/0x6d98ed19b637a79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782878.912980:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782878.917851:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904578816 00000100:00100000:2.0:1787782878.917867:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904578816 00010000:00010000:2.0:1787782878.917916:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54eb expref: 9 pid: 6697 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782878.917971:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:2.0:1787782878.917980:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2352:x1874625904578816:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782878.917995:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787782878.918014:0:5837:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787782878.918017:0:5837:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787782878 00002000:00010000:2.0:1787782878.918019:0:5837:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787782879 00002000:00010000:2.0:1787782878.918021:0:5837:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787782878 00010000:00010000:2.0:1787782878.918050:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54eb expref: 9 pid: 6697 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.918064:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54eb expref: 9 pid: 6697 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.918414:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000335bbc51/0x6d98ed19b637a2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54eb expref: 9 pid: 6697 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.918434:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787782878.918438:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787782878.918443:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000705c0ed4/0x6d98ed19b637a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.918453:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000705c0ed4/0x6d98ed19b637a79 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.918490:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782878.918557:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2352:x1874625904578816:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 578us (5585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782878.918566:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 63 00010000:00010000:0.0:1787782878.918795:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000705c0ed4/0x6d98ed19b637a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.918804:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000705c0ed4/0x6d98ed19b637a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.918830:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000705c0ed4/0x6d98ed19b637a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.918847:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000705c0ed4/0x6d98ed19b637a79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.918854:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000705c0ed4/0x6d98ed19b637a79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.918872:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254e00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782878.918876:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000705c0ed4/0x6d98ed19b637a79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.918884:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000705c0ed4/0x6d98ed19b637a79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.918896:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000705c0ed4/0x6d98ed19b637a79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.918902:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000705c0ed4/0x6d98ed19b637a79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782878.918964:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2350:x1874625904578560:12345-192.168.202.15@tcp:1:lfs.0 Request processed in 23546us (23822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782878.918971:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:3.0:1787782878.928969:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782878.929225:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904579072 00000100:00100000:1.0:1787782878.929235:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904579072 00000100:00100000:1.0:1787782878.929294:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:1.0:1787782878.929303:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310619dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+25:11375:x1874625904579072:12345-192.168.202.15@tcp:35:lfs.0 00000004:00010000:1.0:1787782878.929365:0:5855:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637a6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5507 expref: 25 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787782878.929640:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1787782878.929682:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787782878.930429:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1787782878.930487:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637a80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.930515:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637a17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54dd expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.930524:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637a80 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.930561:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637a17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54dd expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.930576:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637a17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54dd expref: 29 pid: 5851 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782878.930590:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3108268000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1874625922413312:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782878.930679:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782878.933588:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3108268000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5855:1874625922413312:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782878.933619:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637a80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782878.934735:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782878.934798:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904579200 00000100:00100000:0.0:1787782878.934805:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904579200 00010000:00010000:0.0:1787782878.934851:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637a17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54dd expref: 30 pid: 5851 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782878.934893:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:0.0:1787782878.934902:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+30:2349:x1874625904579200:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782878.934917:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782878.934924:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637a17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54dd expref: 30 pid: 5851 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.935463:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637a17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54dd expref: 30 pid: 5851 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.935485:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637a17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e54dd expref: 30 pid: 5851 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.935501:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c200) 00010000:00010000:0.0:1787782878.935507:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637a80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.935515:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637a80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.935523:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637a80 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.935544:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782878.935603:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+29:2349:x1874625904579200:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 701us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782878.935611:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 64 00010000:00010000:1.0:1787782878.935827:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637a80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782878.935844:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637a80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787782878.936655:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787782878.936864:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1787782878.937396:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3108268000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1874625922413440:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787782878.937505:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782878.937575:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782878.945788:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922413440 00000100:00100000:0.0:1787782878.945802:0:12025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922413440 00000100:00100000:0.0:1787782878.945878:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787782878.945889:0:12025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310826b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5855:x1874625922413440:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787782878.946022:0:12025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310826b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5855:x1874625922413440:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 135us (8516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782878.946030:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787782878.946205:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3108268000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1874625922413440:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787782878.946807:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787782878.946898:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d70c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1874625922413568:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787782878.946941:0:5855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782878.946974:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31052ea000 going to sleep for 11 seconds 00000100:00100000:3.0:1787782878.947418:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922413568 00000100:00100000:3.0:1787782878.947424:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922413568 00000100:00100000:3.0:1787782878.947478:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787782878.947486:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5855:x1874625922413568:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787782878.947654:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5855:x1874625922413568:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 168us (712us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787782878.947661:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787782878.947876:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d70c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5855:1874625922413568:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787782878.947935:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1787782878.947973:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637a80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.947985:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637a80 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.947993:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637a80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.947999:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782878.948003:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637a80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.948010:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637a80 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.948024:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c200) 00010000:00010000:2.0:1787782878.948027:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787782878.948032:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637a80 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782878.948037:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637a80 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787782878.948497:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787782878.948629:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1787782878.948640:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363618544168ns, next at 364618541623ns, rc = 0 00000001:00080000:2.0:1787782878.948647:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787782878.948677:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c200) 00010000:00010000:2.0:1787782878.948680:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787782878.948694:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637a6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5507 expref: 33 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782878.948783:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310619dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+32:11375:x1874625904579072:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 19480us (19835us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787782878.948791:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 38 00000020:00080000:2.0:1787782878.948794:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787782878.954547:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782878.960419:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904579328 00000100:00100000:0.0:1787782878.960435:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904579328 00000100:00100000:0.0:1787782878.960557:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 148 00000100:00100000:0.0:1787782878.960569:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+32:11375:x1874625904579328:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787782878.960596:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782878.960618:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637a87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e550e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.960678:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637a87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e550e expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.960692:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637a87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e550e expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782878.960710:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:0.0:1787782878.960713:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787782878.960717:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254200, rc 0) 00000100:00100000:0.0:1787782878.960792:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+33:11375:x1874625904579328:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 226us (6721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782878.960800:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 148 00000100:00100000:3.0:1787782878.965812:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782878.965946:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904579584 00000100:00100000:0.0:1787782878.965956:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904579584 00000100:00100000:0.0:1787782878.966011:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:0.0:1787782878.966021:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+33:11375:x1874625904579584:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787782878.966490:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+34:11375:x1874625904579584:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 470us (687us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1787782878.966498:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:2.0:1787782879.103952:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782879.104655:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904579840 00000100:00100000:1.0:1787782879.104664:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904579840 00000100:00100000:2.0:1787782879.104926:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 149 00000100:00100000:2.0:1787782879.104937:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+34:11385:x1874625904579840:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787782879.104961:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782879.104982:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637a8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5515 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782879.105127:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787782879.105253:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637a8e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5515 expref: 36 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.105267:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312eeef200) 00010000:00010000:2.0:1787782879.105270:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787782879.105274:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637a8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5515 expref: 36 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.105288:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141205e00, rc 0) 00000100:00100000:2.0:1787782879.105354:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+35:11385:x1874625904579840:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 420us (1413us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1787782879.105361:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 149 00000100:00100000:0.0:1787782879.121052:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782879.121196:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904579968 00000100:00100000:1.0:1787782879.121206:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904579968 00000100:00100000:1.0:1787782879.121265:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 150 00000100:00100000:1.0:1787782879.121276:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f134780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+35:11385:x1874625904579968:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:1.0:1787782879.121352:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637a9c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121368:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637a9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121379:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637a9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121393:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637aa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121399:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121405:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121512:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637aaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121520:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121542:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787782879.121595:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121609:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637a9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121617:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637a9c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121624:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637a9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121630:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782879.121634:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637a9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121642:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637a9c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121654:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782879.121657:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782879.121662:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637a9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121667:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637a9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121680:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121691:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637aa3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121708:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121713:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782879.121716:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121723:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637aa3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121733:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c312eeef500) 00010000:00010000:1.0:1787782879.121736:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782879.121738:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637aa3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121743:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637aa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121756:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121769:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637aaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121776:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121781:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782879.121789:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121849:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637aaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121859:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:1.0:1787782879.121862:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782879.121865:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637aaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.121870:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637aaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782879.121948:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f134780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+35:11385:x1874625904579968:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 673us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782879.121956:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 150 00000100:00100000:0.0:1787782879.126818:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782879.126965:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904580224 00000100:00100000:2.0:1787782879.126974:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904580224 00000100:00100000:2.0:1787782879.127033:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:2.0:1787782879.127043:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f136d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+35:11385:x1874625904580224:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787782879.127325:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f136d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+36:11385:x1874625904580224:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 282us (515us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787782879.127333:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:2.0:1787782879.199243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782879.199349:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904580480 00000100:00100000:3.0:1787782879.199359:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904580480 00000100:00100000:3.0:1787782879.199420:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 151 00000100:00100000:3.0:1787782879.199430:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+36:11388:x1874625904580480:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787782879.199454:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782879.199476:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637ab1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e551c expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.199558:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ab8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.199573:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.199586:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.199601:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637abf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.199608:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.199634:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.199767:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.199776:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.199784:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782879.199794:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787782879.199901:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.199909:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ab8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.199916:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.199923:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782879.199927:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.199934:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.200412:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:3.0:1787782879.200417:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782879.200432:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ab8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.200439:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ab8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.200454:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.200460:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637abf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.200467:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.200473:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782879.200476:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.200483:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637abf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.200491:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3104d6e300) 00010000:00010000:3.0:1787782879.200494:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782879.200497:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637abf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.200502:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637abf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.200551:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637ab1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e551c expref: 39 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.200579:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e551c expref: 38 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.200588:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:3.0:1787782879.200590:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787782879.200593:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1e00, rc 0) 00000100:00100000:3.0:1787782879.200653:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+38:11388:x1874625904580480:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1224us (1418us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1787782879.200662:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 151 00000100:00100000:0.0:1787782879.208191:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782879.208351:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904580608 00000100:00100000:1.0:1787782879.208361:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904580608 00000100:00100000:1.0:1787782879.208417:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 152 00000100:00100000:1.0:1787782879.208426:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f135a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+38:11388:x1874625904580608:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:1.0:1787782879.208488:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637ad4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.208506:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.208518:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.208542:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.208569:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.208576:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.208582:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782879.208587:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.208594:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.208606:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:1.0:1787782879.208609:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787782879.208614:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637ad4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.208621:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637ad4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782879.208688:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f135a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+38:11388:x1874625904580608:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 263us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782879.208695:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 152 00000100:00100000:3.0:1787782879.211055:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782879.211172:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904580864 00000100:00100000:1.0:1787782879.211182:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904580864 00000100:00100000:1.0:1787782879.211224:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:1.0:1787782879.211233:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+38:11388:x1874625904580864:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787782879.211441:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+39:11388:x1874625904580864:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 209us (394us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787782879.211462:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:3.0:1787782879.329411:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3108268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922413696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782879.329483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782879.329615:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922413696 00000100:00100000:1.0:1787782879.329624:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922413696 00000100:00100000:1.0:1787782879.329679:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787782879.329689:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922413696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782879.329724:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782879.329772:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922413696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782879.329779:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787782879.329879:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3108268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922413696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782879.330026:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787782879.330034:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f136940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922413824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782879.330063:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782879.330109:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922413824 00000100:00100000:0.0:1787782879.330113:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922413824 00000100:00100000:0.0:1787782879.330138:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787782879.330145:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625922413824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787782879.330157:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782879.330189:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625922413824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782879.330195:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787782879.330224:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f136940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922413824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782879.494157:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782879.494226:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904581120 00000100:00100000:1.0:1787782879.494237:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904581120 00000100:00100000:1.0:1787782879.494298:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 153 00000100:00100000:1.0:1787782879.494309:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+39:11419:x1874625904581120:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:1.0:1787782879.494332:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782879.494353:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637adb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5523 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.494455:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637ae2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.494470:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.494483:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782879.494494:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787782879.494650:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637adb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5523 expref: 42 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.494682:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5523 expref: 41 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.494690:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:1.0:1787782879.494693:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782879.494696:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6a00, rc 0) 00000100:00100000:1.0:1787782879.494752:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+41:11419:x1874625904581120:12345-192.168.202.15@tcp:101:cat.0 Request processed in 445us (608us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787782879.494759:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 153 00000100:00100000:3.0:1787782879.499021:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782879.499134:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782879.499214:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904581376 00000100:00100000:1.0:1787782879.499224:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904581376 00000100:00100000:1.0:1787782879.499285:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:1.0:1787782879.499294:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+41:11419:x1874625904581376:12345-192.168.202.15@tcp:35:cat.0 00000100:00100000:1.0:1787782879.499605:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+42:11419:x1874625904581376:12345-192.168.202.15@tcp:35:cat.0 Request processed in 310us (593us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787782879.499614:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:0.0:1787782879.500409:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904581504 00000100:00100000:0.0:1787782879.500417:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904581504 00000100:00100000:0.0:1787782879.500468:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:0.0:1787782879.500476:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110741680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+42:2351:x1874625904581504:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782879.500488:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782879.500523:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637ae2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5523 expref: 42 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782879.500541:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:0.0:1787782879.500546:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782879.500591:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110741680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+41:2351:x1874625904581504:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 115us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782879.500612:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787782879.567078:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782879.567267:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904581760 00000100:00100000:1.0:1787782879.567278:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904581760 00000100:00100000:1.0:1787782879.567387:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 154 00000100:00100000:1.0:1787782879.567398:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+41:11425:x1874625904581760:12345-192.168.202.15@tcp:101:dd.0 00010000:00010000:1.0:1787782879.567424:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782879.567428:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787782879.567456:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637a48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54f9 expref: 41 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.567495:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782879.567499:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787782879.567512:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637af0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e552a expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.567614:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637af7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.567628:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e551c expref: 41 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.567637:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637af7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.567680:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e551c expref: 41 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782879.567693:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e551c expref: 41 pid: 6719 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782879.567706:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3108268b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922413952:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782879.567922:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787782879.571505:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3108268b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922413952:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787782879.571536:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637af7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782879.573116:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782879.573332:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904581888 00000100:00100000:2.0:1787782879.573341:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904581888 00010000:00010000:2.0:1787782879.573380:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e551c expref: 42 pid: 6719 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782879.573420:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:2.0:1787782879.573429:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+42:2350:x1874625904581888:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782879.573444:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782879.573450:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e551c expref: 42 pid: 6719 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.573462:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e551c expref: 42 pid: 6719 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.573482:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637ac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e551c expref: 42 pid: 6719 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.573498:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:2.0:1787782879.573503:0:7637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637af7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.573523:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637af7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.573531:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637af7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.573555:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782879.573623:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+41:2350:x1874625904581888:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 194us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782879.573631:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 65 00010000:00010000:3.0:1787782879.574359:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637af7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.574380:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637af7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782879.574397:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787782879.574539:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637af0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e552a expref: 42 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.574554:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637af7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e552a expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.574563:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:3.0:1787782879.574566:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787782879.574580:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7400, rc 0) 00000100:00100000:3.0:1787782879.574778:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+41:11425:x1874625904581760:12345-192.168.202.15@tcp:101:dd.0 Request processed in 7382us (7709us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787782879.574786:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 154 00000100:00100000:1.0:1787782879.581452:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782879.582870:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904582144 00000100:00100000:3.0:1787782879.582883:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904582144 00000100:00100000:3.0:1787782879.582947:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 155 00000100:00100000:3.0:1787782879.582956:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108269e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+41:11425:x1874625904582144:12345-192.168.202.15@tcp:36:dd.0 00010000:00010000:3.0:1787782879.583423:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637b05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.583440:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637b05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.583452:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637b05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787782879.583517:0:6719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1787782879.583539:0:6719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003cd66a59 reply state 000000008beedaf3 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637b05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782879.583547:0:6719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787782879.585046:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108269e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+44:11425:x1874625904582144:12345-192.168.202.15@tcp:36:dd.0 Request processed in 2082us (3595us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787782879.585059:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 155 00000020:00080000:3.0:1787782879.585066:0:6719:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787782879.585360:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782879.590622:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637b05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.590934:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637b05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.590944:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637b05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.590949:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782879.590954:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637b05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.591024:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637b05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.591042:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:3.0:1787782879.591045:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782879.591050:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637b05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782879.591057:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637b05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782879.929078:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782879.929321:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904582272 00000100:00100000:2.0:1787782879.929332:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904582272 00000100:00100000:2.0:1787782879.929395:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 156 00000100:00100000:2.0:1787782879.929405:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108268b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+43:11439:x1874625904582272:12345-192.168.202.15@tcp:101:stat.0 00010000:00010000:2.0:1787782879.929431:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782879.929456:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637b0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5531 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.929529:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.929545:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.929557:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.929572:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637b1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.929593:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.929600:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.929698:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.929709:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637af7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e552a expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.929718:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b21 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.929753:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637af7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e552a expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.929767:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637af7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e552a expref: 44 pid: 5852 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782879.929780:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1874625922414080:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787782879.930308:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311f9be240 going to sleep for 11 seconds 00000100:00100000:2.0:1787782879.935018:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1874625922414080:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787782879.935049:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782879.936856:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782879.937666:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904582528 00000100:00100000:2.0:1787782879.937701:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904582528 00000100:00100000:2.0:1787782879.937766:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:2.0:1787782879.937775:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+45:5587:x1874625904582528:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787782879.938249:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+46:5587:x1874625904582528:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 474us (1400us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1787782879.938258:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:1.0:1787782879.943600:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782879.943777:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904582656 00000100:00100000:0.0:1787782879.943787:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904582656 00010000:00010000:0.0:1787782879.943838:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637af7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e552a expref: 46 pid: 5852 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782879.943877:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:0.0:1787782879.943887:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108258000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+46:2349:x1874625904582656:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782879.943901:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782879.943908:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637af7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e552a expref: 46 pid: 5852 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782879.943936:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637af7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e552a expref: 46 pid: 5852 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782879.943958:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7400/0x6d98ed19b637af7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e552a expref: 46 pid: 5852 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782879.943975:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:0.0:1787782879.943980:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782879.943989:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782879.943997:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b21 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782879.944046:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782879.944152:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108258000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+45:2349:x1874625904582656:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 266us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782879.944160:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 66 00010000:00010000:2.0:1787782879.946788:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.946804:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782879.946865:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787782879.946869:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782879.946889:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.946904:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.946926:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.946932:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.946939:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.946945:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782879.946950:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.946976:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.946992:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:2.0:1787782879.946995:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782879.947000:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.947006:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.947024:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.947029:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637b1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.947034:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637b1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.947038:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782879.947041:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637b1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.947046:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637b1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.947051:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3108738800) 00010000:00010000:2.0:1787782879.947053:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782879.947056:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637b1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.947070:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637b1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.947144:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637b0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5531 expref: 45 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.947157:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5531 expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782879.947163:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:2.0:1787782879.947166:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787782879.947168:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204200, rc 0) 00000100:00100000:2.0:1787782879.947235:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108268b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+44:11439:x1874625904582272:12345-192.168.202.15@tcp:101:stat.0 Request processed in 17830us (18331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782879.947244:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 156 00000100:00100000:3.0:1787782880.105217:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782880.105920:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904582912 00000100:00100000:2.0:1787782880.105931:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904582912 00000100:00100000:2.0:1787782880.106015:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 157 00000100:00100000:2.0:1787782880.106025:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+44:11445:x1874625904582912:12345-192.168.202.15@tcp:36:truncate.0 00000100:00080000:1.0:1787782880.106173:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787782880.106343:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782880.106370:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5531 expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.106493:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:2.0:1787782880.106498:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782880.106712:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637b28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.106733:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.106743:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787782880.106921:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787782880.106944:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000236480a7 reply state 000000008d07ed8e transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782880.107308:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787782880.107429:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+46:11445:x1874625904582912:12345-192.168.202.15@tcp:36:truncate.0 Request processed in 1404us (2221us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787782880.107437:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 157 00000020:00080000:2.0:1787782880.107442:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787782880.124008:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.124025:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637b28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.124032:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637b28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.124038:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782880.124042:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637b28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.124050:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637b28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.124065:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:0.0:1787782880.124068:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782880.124072:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637b28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.124088:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637b28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782880.304857:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782880.304977:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904583040 00000100:00100000:1.0:1787782880.304986:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904583040 00000100:00100000:1.0:1787782880.305042:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 158 00000100:00100000:1.0:1787782880.305051:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+45:11459:x1874625904583040:12345-192.168.202.15@tcp:101:stat.0 00010000:00010000:1.0:1787782880.305076:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782880.305125:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637b2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5538 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305195:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305209:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305220:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305235:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637b3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305242:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305249:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305345:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637b44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305353:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305377:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782880.305410:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787782880.305414:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787782880.305433:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305446:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305454:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305461:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305468:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305474:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782880.305478:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305485:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305496:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782880.305499:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782880.305503:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305517:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305531:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305537:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637b3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305543:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305548:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782880.305551:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305556:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637b3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305562:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c312eeef500) 00010000:00010000:1.0:1787782880.305565:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782880.305567:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637b3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305572:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637b3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305598:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637b2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5538 expref: 47 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305610:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5538 expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.305623:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:1.0:1787782880.305625:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782880.305628:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7000, rc 0) 00000100:00100000:1.0:1787782880.305690:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+46:11459:x1874625904583040:12345-192.168.202.15@tcp:101:stat.0 Request processed in 639us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782880.305697:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 158 00000001:00080000:0.0:1787782880.446206:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967432 is committed 00000001:00080000:0.0:1787782880.446230:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967438 is committed 00000001:00080000:0.0:1787782880.446271:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000004:00080000:0.0:1787782880.446283:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787782880.446309:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c31052eab40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787782880.446314:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c3106894100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c31052ea780 00000020:00080000:0.0:1787782880.446318:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c3106894200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c3108251000 00000020:00080000:0.0:1787782880.446346:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787782880.446513:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787782880.446662:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787782880.446690:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922414208:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787782880.446771:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782880.446850:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922414208 00000100:00100000:3.0:1787782880.446858:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922414208 00000100:00100000:3.0:1787782880.446905:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787782880.446914:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922414208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787782880.446940:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1787782880.446975:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f66de, atime: 0x6a8f66df, ctime: 0x6a8f66de, blocks: 0x1 00010000:00010000:3.0:1787782880.446984:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637b4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.447001:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1787782880.447006:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782880.447013:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637b4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.447029:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637b4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.447039:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637b4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.447047:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637b4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.447073:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787782880.447528:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1874625922414208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 614us (756us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787782880.447536:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1787782880.447559:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787782880.447571:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782880.447577:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637b4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.447586:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0000 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787782880.447590:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637b4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.447601:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637b4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.447618:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637b4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.447626:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ace152e/0x6d98ed19b637b4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.447642:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782880.447644:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782880.447646:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787782880.447673:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c313c97f480/2, rc 0, transno 4294967307 00000100:00100000:3.0:1787782880.447683:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922414208:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787782880.498661:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782880.498856:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904583296 00000100:00100000:3.0:1787782880.498868:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904583296 00000100:00100000:3.0:1787782880.498927:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 159 00000100:00100000:3.0:1787782880.498937:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108258b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+16:11469:x1874625904583296:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787782880.498958:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782880.498981:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637b52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e553f expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782880.499628:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787782880.499857:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637b52 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e553f expref: 18 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.499873:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312eeef200) 00010000:00010000:0.0:1787782880.499876:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787782880.499881:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637b52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e553f expref: 18 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.499896:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0000, rc 0) 00000100:00100000:0.0:1787782880.499965:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108258b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+17:11469:x1874625904583296:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1031us (1324us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1787782880.499972:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 159 00000100:00100000:3.0:1787782880.504066:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782880.504268:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904583552 00000100:00100000:2.0:1787782880.504278:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904583552 00000100:00100000:2.0:1787782880.504332:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:2.0:1787782880.504342:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310619d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+17:11469:x1874625904583552:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787782880.505019:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310619d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+18:11469:x1874625904583552:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 677us (961us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787782880.505027:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 44 00010000:00010000:1.0:1787782880.610909:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782880.646964:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782880.648835:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904583808 00000100:00100000:1.0:1787782880.648849:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904583808 00000100:00100000:1.0:1787782880.648986:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 160 00000100:00100000:1.0:1787782880.648997:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+18:11475:x1874625904583808:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787782880.649026:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782880.649048:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637b60 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5546 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.649264:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.649280:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637b44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5538 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.649290:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b67 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.649324:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5538 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782880.649356:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637b44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5538 expref: 19 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782880.649370:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310825ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922414336:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782880.649761:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9e900 going to sleep for 11 seconds 00000100:00100000:3.0:1787782880.654917:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310825ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922414336:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787782880.654951:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782880.657128:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782880.657644:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904583936 00000100:00100000:2.0:1787782880.657665:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904583936 00010000:00010000:2.0:1787782880.657708:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637b44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5538 expref: 20 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782880.657757:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:2.0:1787782880.657781:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+20:2349:x1874625904583936:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782880.657797:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782880.657805:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637b44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5538 expref: 20 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.657829:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5538 expref: 20 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.657852:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637b44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5538 expref: 20 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.657871:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:2.0:1787782880.657876:0:7637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.657885:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.657893:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b67 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.657923:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782880.657991:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+19:2349:x1874625904583936:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 211us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782880.657999:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 67 00010000:00010000:3.0:1787782880.658297:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.658306:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782880.658324:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787782880.658453:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637b60 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5546 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.658465:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5546 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.658480:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:3.0:1787782880.658482:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787782880.658484:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6a00, rc 0) 00000100:00100000:3.0:1787782880.658506:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+19:11475:x1874625904583808:12345-192.168.202.15@tcp:101:bash.0 Request processed in 9513us (11555us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1787782880.658512:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 160 00000100:00100000:1.0:1787782880.661031:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782880.661253:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904584192 00000100:00100000:2.0:1787782880.661261:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904584192 00000100:00100000:2.0:1787782880.661311:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 161 00000100:00100000:2.0:1787782880.661321:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+19:11475:x1874625904584192:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:2.0:1787782880.661620:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.661637:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.661831:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787782880.661888:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787782880.661914:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033737877 reply state 0000000060b7ff49 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782880.661922:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787782880.662041:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+22:11475:x1874625904584192:12345-192.168.202.15@tcp:36:bash.0 Request processed in 719us (1018us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787782880.662049:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 161 00000020:00080000:2.0:1787782880.662054:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787782880.670771:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.670788:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.670796:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.670802:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782880.670808:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.670816:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.670844:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:3.0:1787782880.670847:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782880.670852:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.670860:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637b75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782880.679055:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782880.679337:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904584320 00000100:00100000:2.0:1787782880.679347:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904584320 00000100:00100000:2.0:1787782880.679407:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 162 00000100:00100000:2.0:1787782880.679418:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+21:11475:x1874625904584320:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787782880.679443:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782880.679461:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637b7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e554d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.679530:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.679541:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b67 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5546 expref: 22 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.679558:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b83 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.679584:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5546 expref: 22 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.679594:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b67 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5546 expref: 22 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782880.679604:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1874625922414464:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787782880.679766:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311f9bed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787782880.683267:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782880.683384:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904584448 00000100:00100000:0.0:1787782880.683391:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904584448 00010000:00010000:0.0:1787782880.683424:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b67 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5546 expref: 23 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782880.683455:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:0.0:1787782880.683464:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+23:2350:x1874625904584448:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782880.683496:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782880.683502:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b67 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5546 expref: 23 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.683512:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b67 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5546 expref: 23 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.683532:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:0.0:1787782880.683536:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.683543:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.683549:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b83 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.683564:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782880.683616:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+23:2350:x1874625904584448:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 154us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782880.683621:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 68 00010000:00010000:2.0:1787782880.683705:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637b67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5546 expref: 22 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782880.683723:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1874625922414464:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787782880.683743:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.683751:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.683757:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782880.683808:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787782880.683811:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782880.683842:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.683872:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637b7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e554d expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.683882:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e554d expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782880.683887:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:2.0:1787782880.683889:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787782880.683891:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141205a00, rc 0) 00000100:00100000:2.0:1787782880.683909:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+21:11475:x1874625904584320:12345-192.168.202.15@tcp:101:bash.0 Request processed in 4494us (4867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782880.683913:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 162 00000100:00100000:3.0:1787782880.687811:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782880.688169:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904584704 00000100:00100000:2.0:1787782880.688177:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904584704 00000100:00100000:2.0:1787782880.688480:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:2.0:1787782880.688487:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+21:11475:x1874625904584704:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:2.0:1787782880.688941:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+22:11475:x1874625904584704:12345-192.168.202.15@tcp:35:bash.0 Request processed in 452us (1138us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1787782880.688949:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:1.0:1787782880.756091:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782880.756201:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904584960 00000100:00100000:0.0:1787782880.756212:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904584960 00000100:00100000:0.0:1787782880.756287:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 163 00000100:00100000:0.0:1787782880.756298:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+22:11485:x1874625904584960:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787782880.756323:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782880.756345:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637b8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5554 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782880.756583:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787782880.756725:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637b8a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5554 expref: 24 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.756737:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312eeef200) 00010000:00010000:0.0:1787782880.756739:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787782880.756743:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637b8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5554 expref: 24 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.756754:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255800, rc 0) 00000100:00100000:0.0:1787782880.756814:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+23:11485:x1874625904584960:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 518us (732us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1787782880.756831:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 163 00000100:00100000:1.0:1787782880.760520:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782880.760925:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904585088 00000100:00100000:3.0:1787782880.760935:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904585088 00000100:00100000:3.0:1787782880.761171:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 164 00000100:00100000:3.0:1787782880.761192:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+23:11485:x1874625904585088:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:3.0:1787782880.761266:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637b98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761296:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637b98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761309:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637b98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761324:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637b9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761330:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761336:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761742:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ba6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761752:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761771:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787782880.761856:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761870:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637b98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761876:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637b98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761882:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637b98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761888:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782880.761891:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637b98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761897:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637b98 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761909:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:3.0:1787782880.761912:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782880.761916:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637b98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761922:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637b98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761934:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761938:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637b9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761965:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761971:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782880.761973:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761980:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637b9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.761988:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3104d6e300) 00010000:00010000:3.0:1787782880.761991:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782880.761994:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637b9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.762007:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637b9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.762022:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.762029:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ba6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.762035:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.762040:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782880.762043:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.762073:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ba6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.762081:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:3.0:1787782880.762083:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782880.762086:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ba6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.762091:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ba6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782880.762284:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+23:11485:x1874625904585088:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 1102us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782880.762292:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 164 00000100:00100000:1.0:1787782880.766834:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782880.767019:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904585344 00000100:00100000:2.0:1787782880.767030:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904585344 00000100:00100000:2.0:1787782880.767155:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:2.0:1787782880.767167:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+23:11485:x1874625904585344:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787782880.767659:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+24:11485:x1874625904585344:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 493us (845us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787782880.767688:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:1.0:1787782880.783885:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782880.783932:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782880.783977:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782880.784071:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904585856 00000100:00100000:0.0:1787782880.784081:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904585856 00000100:00100000:0.0:1787782880.784172:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 169 00000100:00100000:0.0:1787782880.784191:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2350:x1874625904585856:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782880.784277:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2350:x1874625904585856:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 97us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782880.784286:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 169 00000100:00100000:1.0:1787782880.784673:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782880.785194:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904585600 00000100:00100000:2.0:1787782880.785202:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904585600 00000100:00100000:2.0:1787782880.785243:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904585728 00000100:00100000:2.0:1787782880.785246:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904585728 00000100:00100000:2.0:1787782880.785271:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 100 00000100:00100000:2.0:1787782880.785279:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904585600:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782880.785327:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904585600:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 48us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782880.785334:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 100 00000100:00100000:2.0:1787782880.785348:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:2.0:1787782880.785354:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2350:x1874625904585728:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782880.785376:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2350:x1874625904585728:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 23us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782880.785382:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00080000:2.0:1787782880.785686:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787782880.785691:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787782880.785694:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782880.786123:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904585472 00000100:00100000:3.0:1787782880.786131:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904585472 00000100:00100000:3.0:1787782880.786256:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 303 00000100:00100000:3.0:1787782880.786266:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2350:x1874625904585472:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782880.786302:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2350:x1874625904585472:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 38us (2325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782880.786309:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 303 00000100:00100000:0.0:1787782880.833086:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782880.833379:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904586112 00000100:00100000:2.0:1787782880.833390:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904586112 00000100:00100000:3.0:1787782880.833576:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 165 00000100:00100000:3.0:1787782880.833589:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f136940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+24:11488:x1874625904586112:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787782880.833615:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782880.833636:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637bad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e555b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.833731:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637bb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.833745:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.833767:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.833781:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637bbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.833789:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.833796:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834199:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637bc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834208:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834216:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782880.834226:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787782880.834314:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834322:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637bb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834335:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834341:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782880.834346:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834354:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637bb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834366:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:3.0:1787782880.834369:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782880.834374:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637bb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834379:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637bb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834391:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834397:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637bbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834402:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834406:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782880.834409:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834422:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637bbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834430:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3104d6e300) 00010000:00010000:3.0:1787782880.834432:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782880.834434:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637bbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834439:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637bbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834477:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637bad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e555b expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834490:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e555b expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782880.834498:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:3.0:1787782880.834501:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787782880.834503:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1600, rc 0) 00000100:00100000:3.0:1787782880.834574:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f136940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+26:11488:x1874625904586112:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 987us (1496us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1787782880.834582:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 165 00000100:00100000:3.0:1787782880.840509:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782880.840595:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904586240 00000100:00100000:0.0:1787782880.840604:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904586240 00000100:00100000:0.0:1787782880.840666:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 166 00000100:00100000:0.0:1787782880.840676:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+26:11488:x1874625904586240:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:0.0:1787782880.840772:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637bd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.840790:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.840801:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.840835:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.840841:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637bd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.840848:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.840853:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782880.840857:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.840864:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637bd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.840877:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:0.0:1787782880.840880:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787782880.840884:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637bd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.840890:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637bd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782880.840981:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+26:11488:x1874625904586240:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 306us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782880.840988:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 166 00000100:00100000:2.0:1787782880.848278:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782880.848814:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904586368 00000100:00100000:0.0:1787782880.848833:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904586368 00000100:00100000:0.0:1787782880.848901:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:0.0:1787782880.848912:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+26:2351:x1874625904586368:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782880.848931:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782880.848958:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637bc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e555b expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782880.848978:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:0.0:1787782880.848983:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782880.849042:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+25:2351:x1874625904586368:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 131us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782880.849049:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:1.0:1787782880.864303:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782880.864394:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904586624 00000100:00100000:2.0:1787782880.864402:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904586624 00000100:00100000:2.0:1787782880.864446:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:2.0:1787782880.864453:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+25:11488:x1874625904586624:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787782880.864675:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+26:11488:x1874625904586624:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 221us (382us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787782880.864695:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:3.0:1787782881.113412:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782881.113718:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904586880 00000100:00100000:1.0:1787782881.113728:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904586880 00000100:00100000:1.0:1787782881.113804:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 167 00000100:00100000:1.0:1787782881.113825:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+26:11506:x1874625904586880:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:1.0:1787782881.113856:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782881.113880:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637bd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5562 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.113978:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637bde lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.114006:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637bde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.114017:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637bde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782881.114030:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787782881.114219:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637bd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5562 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.114236:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637bde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5562 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.114245:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:1.0:1787782881.114247:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787782881.114251:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6a00, rc 0) 00000100:00100000:1.0:1787782881.114478:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+28:11506:x1874625904586880:12345-192.168.202.15@tcp:101:cat.0 Request processed in 664us (1075us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787782881.114486:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 167 00000100:00100000:3.0:1787782881.189266:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782881.189431:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904587008 00000100:00100000:0.0:1787782881.189442:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904587008 00000100:00100000:0.0:1787782881.189505:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 168 00000100:00100000:0.0:1787782881.189516:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+28:11507:x1874625904587008:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787782881.189541:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782881.189562:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637bec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5569 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.189628:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637bf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.189656:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.189668:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782881.189881:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787782881.189886:0:6719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787782881.189963:0:6719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.189992:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637bec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5569 expref: 30 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.190008:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5569 expref: 29 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.190017:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:0.0:1787782881.190020:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787782881.190024:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255800, rc 0) 00000100:00100000:0.0:1787782881.190086:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+29:11507:x1874625904587008:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 572us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782881.190138:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 168 00000100:00100000:2.0:1787782881.197001:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782881.197087:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904587392 00000100:00100000:0.0:1787782881.197125:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904587392 00000100:00100000:0.0:1787782881.197175:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:0.0:1787782881.197200:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+29:11507:x1874625904587392:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:0.0:1787782881.197513:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+30:11507:x1874625904587392:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 329us (521us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1787782881.197534:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:3.0:1787782881.207757:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782881.207904:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904587520 00000100:00100000:2.0:1787782881.207914:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904587520 00000100:00100000:2.0:1787782881.207984:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:2.0:1787782881.207995:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102e11050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+30:11507:x1874625904587520:12345-192.168.202.15@tcp:103:lfs.0 00010000:00010000:2.0:1787782881.208011:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787782881.208037:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637b83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e554d expref: 30 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.208060:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637bde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5562 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.208075:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637a87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e550e expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.208085:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c310823c300) 00010000:00010000:2.0:1787782881.208148:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782881.208211:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102e11050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+27:11507:x1874625904587520:12345-192.168.202.15@tcp:103:lfs.0 Request processed in 218us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782881.208219:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:3.0:1787782881.210920:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782881.211068:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904587648 00000100:00100000:1.0:1787782881.211077:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904587648 00000100:00100000:1.0:1787782881.211168:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 169 00000100:00100000:1.0:1787782881.211178:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+27:11507:x1874625904587648:12345-192.168.202.15@tcp:58:lfs.0 00010000:00010000:1.0:1787782881.211436:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637bfa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.211453:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637bfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.211475:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637bfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787782881.211857:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1787782881.212026:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+27:11507:x1874625904587648:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 848us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782881.212034:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 169 00000100:00100000:1.0:1787782881.283560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782881.283662:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904587776 00000100:00100000:0.0:1787782881.283673:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904587776 00000100:00100000:0.0:1787782881.283733:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 170 00000100:00100000:0.0:1787782881.283743:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+27:11509:x1874625904587776:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787782881.283767:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782881.283788:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637c01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5570 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.283865:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.283882:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.283894:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.283908:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.283914:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.283921:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284683:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637c16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284705:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284713:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782881.284754:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787782881.284759:0:6719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787782881.284780:0:6719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284791:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284799:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284805:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284822:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284830:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782881.284834:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284842:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284854:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:0.0:1787782881.284857:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782881.284867:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284874:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284888:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284895:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284900:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284904:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782881.284907:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284912:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284919:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c310823cd00) 00010000:00010000:0.0:1787782881.284921:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782881.284924:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284929:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284973:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637c01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5570 expref: 29 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.284999:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5570 expref: 28 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.285007:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef600) 00010000:00010000:0.0:1787782881.285009:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787782881.285011:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254e00, rc 0) 00000100:00100000:0.0:1787782881.286167:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+28:11509:x1874625904587776:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 2417us (2612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782881.286178:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 170 00000040:00080000:1.0:1787782881.377940:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787782881.377949:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787782881.377988:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787782881.377995:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787782881.380965:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874625922414592:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787782881.381200:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9e480 going to sleep for 11 seconds 00000100:00100000:1.0:1787782881.396643:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782881.396769:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874625922414592:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787782881.397060:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904587904 00000100:00100000:3.0:1787782881.397068:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904587904 00000100:00100000:0.0:1787782881.397250:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 171 00000100:00100000:0.0:1787782881.397263:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+28:11520:x1874625904587904:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787782881.397310:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787782881.397449:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+28:11520:x1874625904587904:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 189us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782881.397458:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 171 00000100:00100000:3.0:1787782881.407996:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782881.408403:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904588032 00000100:00100000:2.0:1787782881.408413:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904588032 00000100:00100000:2.0:1787782881.408473:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 172 00000100:00100000:2.0:1787782881.408483:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+28:11520:x1874625904588032:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787782881.408569:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637c1d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.408587:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637c1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.408602:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637c1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.408618:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c24 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.408625:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.408632:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.408658:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637c2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.408667:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.408686:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782881.408726:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787782881.408730:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782881.408745:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.408755:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637c1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.408767:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637c1d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.408773:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637c1d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.408779:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782881.408784:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637c1d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.408792:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637c1d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.408805:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c312eeef700) 00010000:00010000:2.0:1787782881.408808:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782881.410085:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637c1d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.410914:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b637c1d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.410937:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.410944:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c24 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.411003:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.411009:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782881.411028:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.411036:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c24 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.411050:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8c3108738800) 00010000:00010000:2.0:1787782881.411053:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782881.411057:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c24 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.411063:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c24 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.411081:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.411088:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637c2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.411120:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.411127:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782881.411130:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.411660:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637c2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.411679:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef600) 00010000:00010000:2.0:1787782881.411682:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782881.411693:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637c2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.411700:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637c2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782881.411804:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+28:11520:x1874625904588032:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 Request processed in 3320us (3816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782881.413907:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 172 00000100:00100000:1.0:1787782881.423766:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782881.423964:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904588288 00000100:00100000:0.0:1787782881.423974:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904588288 00000100:00100000:0.0:1787782881.424034:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 173 00000100:00100000:0.0:1787782881.424044:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+28:11520:x1874625904588288:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787782881.424064:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782881.424085:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637c32 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5577 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.424214:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.424244:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.424257:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782881.424268:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787782881.424376:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.424383:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.424390:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.424395:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782881.424399:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.424407:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.424419:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef600) 00010000:00010000:0.0:1787782881.424422:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787782881.424427:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.424434:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.424475:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637c32 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5577 expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.424491:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c312eeef700) 00010000:00010000:0.0:1787782881.424494:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787782881.424498:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637c32 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5577 expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.424507:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255200, rc 0) 00000100:00100000:0.0:1787782881.424567:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+29:11520:x1874625904588288:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 524us (811us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1787782881.424575:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 173 00000100:00100000:1.0:1787782881.427728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782881.427825:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904588416 00000100:00100000:3.0:1787782881.427834:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904588416 00000100:00100000:3.0:1787782881.427893:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 174 00000100:00100000:3.0:1787782881.427903:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+29:11520:x1874625904588416:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787782881.427973:0:6719:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787782881.428082:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+29:11520:x1874625904588416:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 180us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782881.428090:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 174 00000100:00100000:1.0:1787782881.437626:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782881.437766:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904588672 00000100:00100000:0.0:1787782881.437775:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904588672 00000100:00100000:0.0:1787782881.437840:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 175 00000100:00100000:0.0:1787782881.437851:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+29:11520:x1874625904588672:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787782881.437871:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782881.437874:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787782881.437900:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255800/0x6d98ed19b637bf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5569 expref: 29 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.437918:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:0.0:1787782881.437923:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787782881.437936:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e557e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787782881.438906:0:5852:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787782881.439658:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637c4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.440077:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.440091:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.440414:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e557e expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.440432:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e557e expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.440441:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c310823cd00) 00010000:00010000:0.0:1787782881.440444:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787782881.440448:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255c00, rc 0) 00000100:00100000:0.0:1787782881.440517:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+30:11520:x1874625904588672:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 2668us (2900us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787782881.440526:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 175 00000100:00100000:1.0:1787782881.444857:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782881.445008:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904588928 00000100:00100000:3.0:1787782881.445018:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904588928 00000100:00100000:3.0:1787782881.445117:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 176 00000100:00100000:3.0:1787782881.445129:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+30:11520:x1874625904588928:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787782881.445205:0:6719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782881.445233:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637c4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e557e expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445252:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c310823cd00) 00010000:00010000:3.0:1787782881.445263:0:6719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787782881.445296:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637c5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445310:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637c5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445318:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637c5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445399:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637c63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x8bf7239e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445408:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637c63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8bf7239e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445414:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637c63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8bf7239e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445654:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637c5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445662:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637c5c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445668:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637c5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445685:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782881.445689:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637c5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445697:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637c5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445706:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:3.0:1787782881.445708:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782881.445712:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637c5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445719:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637c5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445733:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637c63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8bf7239e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445740:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637c63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8bf7239e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445752:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637c63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8bf7239e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445757:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782881.445760:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637c63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8bf7239e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445766:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637c63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8bf7239e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445773:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x8bf7239e (ffff8c3104d6e300) 00010000:00010000:3.0:1787782881.445775:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782881.445778:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637c63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8bf7239e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.445783:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637c63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8bf7239e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782881.445876:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+29:11520:x1874625904588928:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 748us (1026us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787782881.445883:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 176 00000100:00100000:1.0:1787782881.448808:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782881.448912:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904589056 00000100:00100000:3.0:1787782881.448924:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904589056 00000100:00100000:3.0:1787782881.451225:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 177 00000100:00100000:3.0:1787782881.451263:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+29:11520:x1874625904589056:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787782881.451387:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782881.451411:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637c6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5585 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.451448:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637c71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.451463:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.451475:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.451583:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637c6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5585 expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.451604:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5585 expref: 30 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.451614:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3104d6e500) 00010000:00010000:3.0:1787782881.451618:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787782881.451622:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1e00, rc 0) 00000100:00100000:3.0:1787782881.451696:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+30:11520:x1874625904589056:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 441us (3019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782881.451703:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 177 00000100:00100000:2.0:1787782881.462029:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782881.462402:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904589312 00000100:00100000:0.0:1787782881.462419:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904589312 00000100:00100000:0.0:1787782881.462488:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 178 00000100:00100000:0.0:1787782881.462499:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110741680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+30:11520:x1874625904589312:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787782881.462597:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.462614:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.462639:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787782881.462990:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:0.0:1787782881.463000:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366132903448ns, next at 367132901287ns, rc = 0 00000004:00010000:0.0:1787782881.463074:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e84d40ea reply state 00000000a7a80982 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782881.463124:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787782881.463371:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110741680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+32:11520:x1874625904589312:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 872us (1352us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787782881.463379:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 178 00000100:00100000:0.0:1787782881.469817:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782881.469900:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904589440 00000100:00100000:2.0:1787782881.469910:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904589440 00000100:00100000:2.0:1787782881.469964:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 179 00000100:00100000:2.0:1787782881.469974:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f1370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+32:11520:x1874625904589440:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787782881.469999:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782881.470019:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e558c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.470080:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e558c expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.470092:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e558c expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.470120:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3104d6e500) 00010000:00010000:2.0:1787782881.470123:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787782881.470126:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141205200, rc 0) 00000100:00100000:2.0:1787782881.470177:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f1370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+33:11520:x1874625904589440:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 206us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782881.470190:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 179 00010000:00010000:1.0:1787782881.473972:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.473991:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.473999:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.474017:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782881.474022:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.474031:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.474051:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3104d6e500) 00010000:00010000:1.0:1787782881.474054:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787782881.474060:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.474067:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255000/0x6d98ed19b637c78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782881.476085:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782881.476235:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904589568 00000100:00100000:0.0:1787782881.476243:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904589568 00000100:00100000:0.0:1787782881.476302:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:0.0:1787782881.476311:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2351:x1874625904589568:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787782881.476660:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2351:x1874625904589568:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 349us (584us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787782881.476668:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:2.0:1787782881.480266:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782881.480389:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904589824 00000100:00100000:1.0:1787782881.480398:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904589824 00000100:00100000:1.0:1787782881.480484:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:1.0:1787782881.480492:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+32:11520:x1874625904589824:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787782881.480690:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+33:11520:x1874625904589824:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 198us (428us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1787782881.480697:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:2.0:1787782881.483336:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782881.483375:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904590080 00000100:00100000:2.0:1787782881.483385:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904590080 00000100:00100000:2.0:1787782881.483442:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 180 00000100:00100000:2.0:1787782881.483450:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+33:11520:x1874625904590080:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787782881.483555:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+33:11520:x1874625904590080:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 104us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782881.483562:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 180 00000100:00100000:2.0:1787782881.491905:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782881.492074:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904590208 00000100:00100000:0.0:1787782881.492086:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904590208 00000100:00100000:0.0:1787782881.492543:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 181 00000100:00100000:0.0:1787782881.492555:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+33:11520:x1874625904590208:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787782881.492591:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782881.492612:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637c86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5593 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.492691:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.492705:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.492718:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782881.492759:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787782881.492779:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.492806:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637c86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5593 expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.492832:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5593 expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.492839:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3104d6e500) 00010000:00010000:0.0:1787782881.492843:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787782881.492847:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254600, rc 0) 00000100:00100000:0.0:1787782881.492913:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+34:11520:x1874625904590208:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 362us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782881.492920:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 181 00000100:00100000:0.0:1787782881.499662:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782881.500224:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904590336 00000100:00100000:1.0:1787782881.500236:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904590336 00000100:00100000:1.0:1787782881.500303:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:1.0:1787782881.500313:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f136580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2349:x1874625904590336:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787782881.500340:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782881.500362:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b637c94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e559a expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787782881.500390:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f66e1, blocks: 0x1 00010000:00010000:1.0:1787782881.500410:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=366s v=(0 0) 00010000:00010000:1.0:1787782881.500415:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782881.500425:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b637c94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e559a expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.500445:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b637c94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e559a expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.500458:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7200, rc 0) 00000100:00100000:1.0:1787782881.500514:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f136580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2349:x1874625904590336:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 203us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782881.500521:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:2.0:1787782881.504931:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782881.505026:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904590592 00000100:00100000:3.0:1787782881.505035:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904590592 00000100:00100000:3.0:1787782881.505086:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 182 00000100:00100000:3.0:1787782881.505145:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+34:11520:x1874625904590592:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787782881.505254:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+34:11520:x1874625904590592:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 119us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782881.505262:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 182 00000100:00100000:0.0:1787782881.514064:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782881.514413:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904590720 00000100:00100000:1.0:1787782881.514424:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904590720 00000100:00100000:1.0:1787782881.514486:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:1.0:1787782881.514497:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f137c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+8:11520:x1874625904590720:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787782881.514517:0:6967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782881.514539:0:6967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b637c9b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e55a1 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.514801:0:6967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b637c94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e559a expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.514834:0:6967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782881.514840:0:6967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782881.514846:0:6967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b637c9b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55a1 expref: 9 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.514886:0:6967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b637c94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e559a expref: 9 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.514901:0:6967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b637c94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e559a expref: 9 pid: 6698 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782881.514915:0:6967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6967:1874625922414720:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782881.515013:0:6967:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782881.524722:0:6967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6967:1874625922414720:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787782881.524779:0:6967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b637c9b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55a1 expref: 9 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.524801:0:6967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7400, rc 0) 00000100:00100000:0.0:1787782881.524903:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f137c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+9:11520:x1874625904590720:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 10407us (10851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782881.524913:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:3.0:1787782881.531621:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782881.531725:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904590848 00000100:00100000:0.0:1787782881.531736:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904590848 00010000:00010000:0.0:1787782881.532224:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b637c94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e559a expref: 9 pid: 6698 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782881.532277:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:0.0:1787782881.532287:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2349:x1874625904590848:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782881.532302:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782881.532326:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b637c94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e559a expref: 9 pid: 6698 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.532341:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b637c94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e559a expref: 9 pid: 6698 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.532364:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b637c94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e559a expref: 9 pid: 6698 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.532379:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782881.532391:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782881.532400:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b637c9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55a1 expref: 8 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.532412:0:7637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b637c9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55a1 expref: 8 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.532453:0:7637:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b637c9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55a1 expref: 8 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782881.532468:0:7637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f134b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7637:1874625922414848:192.168.202.15@tcp:105: 00000100:00100000:0.0:1787782881.534521:0:7637:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107fe3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782881.547954:0:7637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f134b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7637:1874625922414848:192.168.202.15@tcp:105: 00010000:00010000:0.0:1787782881.547984:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782881.548043:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2349:x1874625904590848:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 15756us (16427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782881.548054:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:1.0:1787782881.562425:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782881.562584:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904590976 00000100:00100000:3.0:1787782881.562595:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904590976 00002000:00100000:3.0:1787782881.562647:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8c312f16e940 x1874625904590976/t0(0) o4->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:272/0 lens 504/0 e 0 to 0 dl 1787782892 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787782881.562659:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c312f16e940 with x1874625904590976 ext(0->8) 00002000:00010000:3.0:1787782881.562665:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c312f16e940 00000100:00100000:3.0:1787782881.562700:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:3.0:1787782881.562710:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2350:x1874625904590976:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787782881.563449:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+10:2350:x1874625904590976:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 Request processed in 737us (1032us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787782881.563461:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00002000:00100000:3.0:1787782881.563469:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8c312f16e940 x1874625904590976/t4294967314(0) o4->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:272/0 lens 504/448 e 0 to 0 dl 1787782892 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787782881.563478:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c312f16e940 with x1874625904590976 ext(0->8) 00002000:00010000:3.0:1787782881.563482:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c312f16e940 00000100:00100000:3.0:1787782881.566378:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782881.566519:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904591104 00000100:00100000:1.0:1787782881.566529:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904591104 00000100:00100000:1.0:1787782881.566602:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 183 00000100:00100000:1.0:1787782881.566613:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+34:11520:x1874625904591104:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1787782881.646267:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782881.712862:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+34:11520:x1874625904591104:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 Request processed in 146238us (146482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782881.712877:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 183 00000001:00080000:0.0:1787782881.717608:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:0.0:1787782881.717626:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1787782881.717666:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:0.0:1787782881.717685:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:0.0:1787782881.717726:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1787782881.717736:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787782881.724499:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922414976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787782881.724592:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782881.724690:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922414976 00000100:00100000:1.0:1787782881.724697:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922414976 00000100:00100000:1.0:1787782881.724753:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787782881.724763:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922414976:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787782881.724937:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787782881.724941:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787782881 00002000:00010000:1.0:1787782881.724944:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787782881.724946:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787782881 -> 1787782881 00002000:00010000:1.0:1787782881.724948:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787782881.724988:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922414976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 226us (396us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787782881.724995:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787782881.725016:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787782881.725046:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c312f3d4b40/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787782881.725052:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922414976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787782881.735028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782881.735284:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904591232 00000100:00100000:0.0:1787782881.735295:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904591232 00000100:00100000:0.0:1787782881.735357:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:0.0:1787782881.735367:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+10:2352:x1874625904591232:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787782881.833662:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+10:2352:x1874625904591232:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 Request processed in 98284us (98632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782881.833676:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 55 00000001:00080000:3.0:1787782881.835178:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1787782881.835199:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:3.0:1787782881.835212:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:2.0:1787782881.841831:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782881.842147:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904591488 00000100:00100000:3.0:1787782881.842158:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904591488 00000100:00100000:3.0:1787782881.842206:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 184 00000100:00100000:3.0:1787782881.842217:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+18:11520:x1874625904591488:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787782881.842283:0:6719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782881.842313:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637c8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5593 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.842331:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3104d6e500) 00010000:00010000:3.0:1787782881.842337:0:6719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787782881.842370:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ca2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.842383:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.842394:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787782881.842664:0:6719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004acd8159 reply state 0000000097167f10 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782881.842674:0:6719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787782881.842777:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+19:11520:x1874625904591488:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 562us (968us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787782881.842817:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 184 00000100:00100000:3.0:1787782881.850057:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782881.850281:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904591616 00000100:00100000:0.0:1787782881.850291:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904591616 00000100:00100000:0.0:1787782881.850350:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:0.0:1787782881.850361:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2349:x1874625904591616:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787782881.850630:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787782881.850634:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787782881 -> 1787782880 00002000:00010000:0.0:1787782881.850637:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787782879 00002000:00010000:0.0:1787782881.850639:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787782881 -> 1787782880 00002000:00010000:0.0:1787782881.850641:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787782881.850701:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2349:x1874625904591616:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 342us (654us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787782881.850710:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 56 00010000:00010000:1.0:1787782881.850853:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.850864:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ca2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.850872:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.850878:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782881.850882:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.850891:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ca2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.850939:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3104d6e500) 00010000:00010000:1.0:1787782881.850942:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782881.850948:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ca2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.850954:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ca2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782881.865164:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782881.865372:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904591872 00000100:00100000:3.0:1787782881.865383:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904591872 00000100:00100000:3.0:1787782881.865456:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 185 00000100:00100000:3.0:1787782881.865467:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+18:11520:x1874625904591872:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787782881.865538:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ca9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.865556:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637c71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5585 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.865578:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ca9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.865616:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5585 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.865630:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637c71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5585 expref: 18 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782881.865645:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312ee73840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922415104:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787782881.865920:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787782881.881562:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782881.882071:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904592000 00000100:00100000:1.0:1787782881.882081:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904592000 00010000:00010000:1.0:1787782881.882169:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637c71 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5585 expref: 19 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782881.882202:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00100000:1.0:1787782881.882212:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+19:2350:x1874625904592000:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782881.882228:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782881.882236:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637c71 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5585 expref: 19 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.882250:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637c71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5585 expref: 19 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.882286:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3104d6e500) 00010000:00010000:1.0:1787782881.882292:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ca9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.882302:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.882323:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ca9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782881.882343:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782881.882400:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+19:2350:x1874625904592000:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 189us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782881.882407:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 70 00010000:00010000:3.0:1787782881.883587:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637c71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5585 expref: 18 pid: 5851 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782881.883608:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312ee73840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922415104:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787782881.883631:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.883641:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.883663:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.883701:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.883709:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ca9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.883716:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ca9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.883723:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782881.883727:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ca9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.883735:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ca9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.883756:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3104d6e500) 00010000:00010000:3.0:1787782881.883759:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787782881.883763:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ca9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.883769:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ca9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782881.883865:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+17:11520:x1874625904591872:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 Request processed in 18401us (18711us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787782881.883874:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 185 00000100:00100000:2.0:1787782881.886075:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782881.886360:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904592128 00000100:00100000:3.0:1787782881.886370:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904592128 00000100:00100000:3.0:1787782881.886428:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:3.0:1787782881.886439:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c7ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2351:x1874625904592128:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787782881.886483:0:6967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637cb0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.886505:0:6967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b637c9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55a1 expref: 8 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.886514:0:6967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782881.886518:0:6967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787782881.886523:0:6967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637cb0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.886560:0:6967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b637c9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55a1 expref: 8 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.886688:0:6967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b637c9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55a1 expref: 8 pid: 6967 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782881.886705:0:6967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312ee73840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6967:1874625922415232:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787782881.886892:0:6967:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787782881.893399:0:6967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312ee73840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6967:1874625922415232:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787782881.893430:0:6967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637cb0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782881.893628:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782881.893660:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904592256 00000100:00100000:2.0:1787782881.893667:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904592256 00010000:00010000:2.0:1787782881.893716:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b637c9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55a1 expref: 9 pid: 6967 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782881.893758:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 71 00000100:00100000:2.0:1787782881.893768:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2349:x1874625904592256:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782881.893795:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782881.893830:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b637c9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55a1 expref: 9 pid: 6967 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.893842:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b637c9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55a1 expref: 9 pid: 6967 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.893867:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b637c9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55a1 expref: 9 pid: 6967 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.893884:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787782881.893888:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787782881.893893:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637cb0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.893904:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637cb0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.893938:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782881.893986:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2349:x1874625904592256:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 219us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782881.893993:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 71 00010000:00010000:3.0:1787782881.894430:0:6967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637cb0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.894441:0:6967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637cb0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.894467:0:6967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637cb0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.894475:0:6967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637cb0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.894483:0:6967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637cb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.894489:0:6967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0000 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787782881.894493:0:6967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637cb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.894501:0:6967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637cb0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.894514:0:6967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637cb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.894535:0:6967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637cb0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782881.894596:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c7ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2351:x1874625904592128:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 Request processed in 8159us (8528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782881.894605:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:1.0:1787782881.903646:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782881.904171:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904592512 00000100:00100000:3.0:1787782881.904182:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904592512 00000100:00100000:3.0:1787782881.904312:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 186 00000100:00100000:3.0:1787782881.904324:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+17:11520:x1874625904592512:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787782881.904403:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637cb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.904420:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.904432:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.904640:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637cbe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.904651:0:6719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c7f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e558c expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.904658:0:6719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637cbe lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.904715:0:6719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e558c expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.904728:0:6719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e558c expref: 18 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782881.904753:0:6719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312ee73c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6719:1874625922415360:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787782881.904850:0:6719:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787782881.916265:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782881.916560:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904592640 00000100:00100000:0.0:1787782881.916572:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904592640 00010000:00010000:0.0:1787782881.916617:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c7f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e558c expref: 19 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782881.916663:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:0.0:1787782881.916674:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+19:2350:x1874625904592640:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782881.916692:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782881.916700:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c7f lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e558c expref: 19 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.916737:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e558c expref: 19 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.916765:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3104d6e500) 00010000:00010000:0.0:1787782881.916771:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637cbe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.916781:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637cbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.916790:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637cbe lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.916824:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782881.916883:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+19:2350:x1874625904592640:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 210us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782881.916891:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 72 00010000:00010000:3.0:1787782881.917846:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637c7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e558c expref: 18 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782881.917866:0:6719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312ee73c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6719:1874625922415360:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787782881.917893:0:6719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637cbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.917902:0:6719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637cbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.917919:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637cbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787782881.918146:0:6719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787782881.918464:0:6719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787782881.918507:0:6719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787782881.918583:0:6719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312ee73c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6719:1874625922415488:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787782881.918641:0:6719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782881.918676:0:6719:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782881.919588:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922415488 00000100:00100000:0.0:1787782881.919597:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922415488 00000100:00100000:0.0:1787782881.919643:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787782881.919653:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6719:x1874625922415488:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787782881.919780:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6719:x1874625922415488:12345-0@lo:1000:mdt00_003.0 Request processed in 128us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782881.919787:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787782881.920070:0:6719:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1787782881.920076:0:6719:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c312f3d4b40, transno 4294967315 00000100:00100000:3.0:1787782881.920120:0:6719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312ee73c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6719:1874625922415488:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787782881.930875:0:6719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787782881.931066:0:6719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312ee73c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6719:1874625922415616:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787782881.931387:0:6719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782881.931483:0:6719:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782881.938397:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922415616 00000100:00100000:0.0:1787782881.938411:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922415616 00000100:00100000:1.0:1787782881.951957:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787782881.952245:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6719:x1874625922415616:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787782881.952571:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6719:x1874625922415616:12345-0@lo:1000:mdt00_003.0 Request processed in 333us (21183us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787782881.953890:0:6719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312ee73c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6719:1874625922415616:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787782881.954027:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637cbe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.954039:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637cbe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.954048:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637cbe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.954055:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782881.954060:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637cbe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.954068:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637cbe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.954084:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3104d6e500) 00010000:00010000:3.0:1787782881.954087:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787782881.956042:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637cbe lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.956061:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637cbe lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.956126:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637bfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.956141:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637bfa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.956149:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637bfa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.956155:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782881.956159:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637bfa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.956166:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637bfa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.956181:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef600) 00010000:00010000:3.0:1787782881.956184:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787782881.956188:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637bfa lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.956194:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637bfa lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.956215:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637cc5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.956231:0:6719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637c16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5570 expref: 21 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.956240:0:6719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637cc5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.956289:0:6719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5570 expref: 21 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782881.956305:0:6719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637c16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5570 expref: 21 pid: 6719 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782881.956321:0:6719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312ee721c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6719:1874625922415744:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787782881.956410:0:6719:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787782881.967978:0:6719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312ee721c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6719:1874625922415744:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787782881.968018:0:6719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637cc5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782881.968022:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782881.968051:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904592768 00000100:00100000:2.0:1787782881.968066:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904592768 00010000:00010000:2.0:1787782881.968126:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637c16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5570 expref: 22 pid: 6719 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782881.968171:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 73 00000100:00100000:2.0:1787782881.968182:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f134b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+22:2349:x1874625904592768:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782881.968198:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782881.968205:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637c16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5570 expref: 22 pid: 6719 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.968216:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5570 expref: 22 pid: 6719 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.968234:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637c16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5570 expref: 22 pid: 6719 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.968245:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef600) 00010000:00010000:2.0:1787782881.968248:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637cc5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.968256:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637cc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.968262:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637cc5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.968287:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782881.968341:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f134b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+21:2349:x1874625904592768:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 160us (432us total) trans 0 rc 0/0 00010000:00010000:0.0:1787782881.968346:0:6719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637cc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782881.968358:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 73 00010000:00010000:0.0:1787782881.968358:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637cc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.968370:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637cc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.968377:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637cc5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.968384:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637cc5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.968391:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782881.968395:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637cc5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.968402:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637cc5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.968411:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef600) 00010000:00010000:0.0:1787782881.968414:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782881.968417:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637cc5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.968423:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637cc5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.968434:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.968440:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637cb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.968452:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637cb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.968457:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782881.968460:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637cb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.968466:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637cb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.968474:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef600) 00010000:00010000:0.0:1787782881.968477:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787782881.968479:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637cb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782881.968485:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637cb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782881.968705:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+20:11520:x1874625904592512:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 64384us (65067us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1787782881.968713:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 186 00000020:00080000:0.0:1787782881.968717:0:6719:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787782881.969005:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787782881.969010:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787782881.969569:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787782881.969579:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787782881.971232:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787782881.983360:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782881.983402:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904593024 00000100:00100000:2.0:1787782881.983412:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904593024 00000100:00100000:2.0:1787782881.983466:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:2.0:1787782881.983476:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310619c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+20:11520:x1874625904593024:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787782881.984344:0:5855:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787782881.984450:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1787782881.984505:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637ccc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.984524:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637ccc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.984538:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637ccc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.984548:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637ccc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.984555:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637ccc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.984563:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637ccc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.984597:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787782881.984683:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310619c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+22:11520:x1874625904593024:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 1206us (1331us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1787782881.984692:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 50 00000020:00080000:2.0:1787782881.984698:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787782881.986601:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782881.986617:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637ccc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.986628:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204e00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787782881.986632:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637ccc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.986642:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637ccc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.986659:0:6712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c3108738800) 00010000:00010000:2.0:1787782881.986663:0:6712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787782881.986668:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637ccc lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.986675:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637ccc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782881.986697:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782881.986698:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782881.986700:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787782882.474778:0:12471:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787782882.474789:0:12471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787782882.475987:0:12471:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787782882.475997:0:12471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787782882.662652:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782882.688542:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782882.693009:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904593280 00000100:00100000:1.0:1787782882.693035:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904593280 00000100:00100000:1.0:1787782882.693703:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 187 00000100:00100000:1.0:1787782882.693714:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f1361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+22:11530:x1874625904593280:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787782882.693749:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782882.693774:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637cd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e55a8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.694229:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637cda lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.694252:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637cda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.694390:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637cda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782882.694406:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787782882.694587:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637cd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55a8 expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.694605:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637cda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55a8 expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.694614:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782882.694617:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787782882.694621:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7a00, rc 0) 00000100:00100000:1.0:1787782882.694698:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f1361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+24:11530:x1874625904593280:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 985us (6168us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787782882.694706:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 187 00000100:00080000:2.0:1787782882.701243:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782882.702419:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782882.702616:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904593408 00000100:00100000:1.0:1787782882.702630:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904593408 00000100:00100000:2.0:1787782882.702899:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 188 00000100:00100000:2.0:1787782882.703036:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+24:11530:x1874625904593408:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:2.0:1787782882.703332:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ce8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.703353:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ce8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.703368:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ce8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.703385:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.703393:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.703400:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.703728:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637cf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.704720:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.704796:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787782882.704977:0:6719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.704993:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ce8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705012:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ce8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705019:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ce8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705026:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782882.705030:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ce8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705038:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ce8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705050:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:2.0:1787782882.705053:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782882.705058:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ce8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705064:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ce8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705081:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705087:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637cef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705890:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705899:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782882.705910:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705924:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637cef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705935:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3108738800) 00010000:00010000:2.0:1787782882.705938:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782882.705942:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637cef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705948:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637cef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705968:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705974:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637cf6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705980:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705985:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782882.705989:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.705994:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637cf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.706000:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3108738300) 00010000:00010000:2.0:1787782882.706002:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782882.706011:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637cf6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.706017:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637cf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782882.706138:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+24:11530:x1874625904593408:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 3093us (3714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782882.706148:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 188 00000100:00100000:3.0:1787782882.784582:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782882.784764:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904593664 00000100:00100000:1.0:1787782882.784775:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904593664 00000100:00100000:1.0:1787782882.785034:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 189 00000100:00100000:1.0:1787782882.785226:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+24:11533:x1874625904593664:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787782882.785252:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782882.785342:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637cfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e55af expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.785440:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637d04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.785455:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.785466:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.785481:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637d0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.785487:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.785493:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.786617:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637d12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.786629:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.786637:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782882.786648:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787782882.787601:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637d04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.787613:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637d04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.787630:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637d04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.787636:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782882.787640:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637d04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.787647:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637d04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.787668:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782882.787671:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782882.787676:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637d04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.787682:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637d04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.787696:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.787702:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637d0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.787708:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.787712:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782882.787715:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.787876:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637d0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.787888:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c312eeef400) 00010000:00010000:1.0:1787782882.787891:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782882.787894:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637d0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.787899:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637d0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.788244:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637cfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55af expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.788326:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55af expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782882.788337:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef900) 00010000:00010000:1.0:1787782882.788340:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782882.788343:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6c00, rc 0) 00000100:00100000:1.0:1787782882.788475:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+26:11533:x1874625904593664:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 3430us (3903us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787782882.788485:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 189 00000100:00100000:2.0:1787782882.799228:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782882.799941:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904593792 00000100:00100000:1.0:1787782882.799953:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904593792 00000100:00100000:1.0:1787782882.800016:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 190 00000100:00100000:1.0:1787782882.800027:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+26:11533:x1874625904593792:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:0.0:1787782882.801225:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637d20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.801250:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.801547:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.801590:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.801598:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637d20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.801605:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637d20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.801612:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782882.801616:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637d20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.801623:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637d20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.801635:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef900) 00010000:00010000:0.0:1787782882.801639:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787782882.801644:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637d20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.801651:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637d20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782882.802041:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+26:11533:x1874625904593792:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 2013us (2820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782882.802059:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 190 00000100:00100000:2.0:1787782882.811720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782882.811832:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904594048 00000100:00100000:1.0:1787782882.811842:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904594048 00000100:00100000:1.0:1787782882.811901:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:1.0:1787782882.811910:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+26:11533:x1874625904594048:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787782882.812197:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+27:11533:x1874625904594048:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 288us (488us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1787782882.812206:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:2.0:1787782882.877763:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782882.878392:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904594304 00000100:00100000:0.0:1787782882.878405:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904594304 00000100:00100000:2.0:1787782882.878591:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 191 00000100:00100000:2.0:1787782882.878602:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+27:11067:x1874625904594304:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787782882.878626:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782882.878646:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637d27 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e55b6 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.878766:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637d2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.878780:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637d12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55af expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.878790:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637d2e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.878839:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55af expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.878871:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55af expref: 28 pid: 5851 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782882.878895:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccdb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922415872:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787782882.879003:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311f9be240 going to sleep for 11 seconds 00000100:00100000:2.0:1787782882.882560:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccdb0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922415872:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787782882.882593:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637d2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782882.884470:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782882.884548:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904594432 00000100:00100000:0.0:1787782882.884569:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904594432 00010000:00010000:0.0:1787782882.884607:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55af expref: 29 pid: 5851 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782882.884644:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 74 00000100:00100000:0.0:1787782882.884653:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+29:2350:x1874625904594432:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782882.884667:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782882.884673:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55af expref: 29 pid: 5851 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.884685:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55af expref: 29 pid: 5851 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.884707:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637d12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55af expref: 29 pid: 5851 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.884724:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef900) 00010000:00010000:0.0:1787782882.884735:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637d2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.884745:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637d2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.884753:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637d2e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.884784:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782882.884860:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+28:2350:x1874625904594432:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 208us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782882.884878:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 74 00010000:00010000:2.0:1787782882.885154:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637d2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.885163:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637d2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782882.885181:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787782882.885336:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637d27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55b6 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.885356:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637d2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55b6 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.885364:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef900) 00010000:00010000:2.0:1787782882.885367:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787782882.885370:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204400, rc 0) 00000100:00100000:2.0:1787782882.885395:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+28:11067:x1874625904594304:12345-192.168.202.15@tcp:101:bash.0 Request processed in 6796us (7643us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787782882.885409:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 191 00000100:00100000:0.0:1787782882.889488:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782882.890857:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904594688 00000100:00100000:2.0:1787782882.890870:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904594688 00000100:00100000:2.0:1787782882.891427:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 192 00000100:00100000:2.0:1787782882.891439:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f135680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+28:11067:x1874625904594688:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:2.0:1787782882.891754:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.891774:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782882.891788:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787782882.891855:0:6719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787782882.891880:0:6719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbcf3941 reply state 000000003c16dfa8 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782882.891889:0:6719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787782882.892013:0:6719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787782882.892433:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f135680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+32:11067:x1874625904594688:12345-192.168.202.15@tcp:36:bash.0 Request processed in 994us (2952us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787782882.892440:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 192 00000020:00080000:2.0:1787782882.892446:0:6719:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787782882.895547:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:3.0:1787782882.895597:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782882.895611:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782882.895620:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782882.895627:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782882.895631:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782882.895640:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782882.895656:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef900) 00010000:00010000:3.0:1787782882.895669:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782882.895674:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782882.895694:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782882.897504:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904594816 00000100:00100000:0.0:1787782882.897519:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904594816 00000100:00100000:0.0:1787782882.897585:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 193 00000100:00100000:0.0:1787782882.897595:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+31:11067:x1874625904594816:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787782882.897620:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782882.897642:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637d43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e55bd expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.898184:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637d43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55bd expref: 32 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.898200:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637d43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55bd expref: 32 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.898220:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef900) 00010000:00010000:0.0:1787782882.898222:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787782882.898226:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254600, rc 0) 00000100:00100000:0.0:1787782882.898302:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+32:11067:x1874625904594816:12345-192.168.202.15@tcp:101:bash.0 Request processed in 708us (2765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782882.898310:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 193 00000100:00100000:3.0:1787782882.906512:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782882.906637:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904594944 00000100:00100000:0.0:1787782882.906647:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904594944 00000100:00100000:0.0:1787782882.906949:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00100000:0.0:1787782882.906961:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:11067:x1874625904594944:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:0.0:1787782882.907001:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782882.907023:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043d62bb5/0x6d98ed19b637d4a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e55c4 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787782882.907062:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f66e0, atime: 0x6a8f66df, ctime: 0x6a8f66e0, blocks: 0xb 00010000:00010000:0.0:1787782882.907085:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=367s v=(0 0) 00010000:00010000:0.0:1787782882.907090:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782882.907134:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043d62bb5/0x6d98ed19b637d4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55c4 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.907151:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000043d62bb5/0x6d98ed19b637d4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55c4 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782882.907165:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255000, rc 0) 00000100:00100000:0.0:1787782882.907230:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+8:11067:x1874625904594944:12345-192.168.202.15@tcp:101:bash.0 Request processed in 271us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782882.907237:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00080000:2.0:1787782882.909582:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787782882.910998:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782882.911090:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904595072 00000100:00100000:2.0:1787782882.911143:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904595072 00002000:00010000:2.0:1787782882.911184:0:6703:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1787782882.911188:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c312f16f480 with x1874625904595072 ext(0->18446744073709551615) 00002000:00010000:2.0:1787782882.911212:0:6703:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c312f16f480. 00000100:00100000:2.0:1787782882.911247:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:2.0:1787782882.911257:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2350:x1874625904595072:12345-192.168.202.15@tcp:10:bash.0 00002000:00010000:2.0:1787782882.911553:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787782882.911557:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787782880 -> 1787782883 00002000:00010000:2.0:1787782882.911559:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787782879 -> 1787782879 00002000:00010000:2.0:1787782882.911562:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787782880 -> 1787782883 00002000:00010000:2.0:1787782882.911564:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787782882.911622:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2350:x1874625904595072:12345-192.168.202.15@tcp:10:bash.0 Request processed in 367us (632us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787782882.911630:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00002000:00010000:2.0:1787782882.911633:0:6703:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1787782882.911635:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c312f16f480 with x1874625904595072 ext(0->18446744073709551615) 00002000:00010000:2.0:1787782882.911639:0:6703:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c312f16f480. 00000100:00100000:0.0:1787782883.063635:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782883.063767:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904595200 00000100:00100000:3.0:1787782883.063778:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904595200 00000100:00100000:3.0:1787782883.063844:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 194 00000100:00100000:3.0:1787782883.063854:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f136580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+32:11548:x1874625904595200:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:3.0:1787782883.063924:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637d51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.063942:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637d51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.063968:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637d51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.063984:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637d58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.063991:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637d58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.063998:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637d58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064650:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064661:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064676:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787782883.064716:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064739:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637d51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064746:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637d51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064752:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637d51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064757:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782883.064761:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637d51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064767:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637d51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064779:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:3.0:1787782883.064781:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782883.064786:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637d51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064792:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637d51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064814:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637d58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064826:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637d58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064831:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637d58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064836:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782883.064838:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637d58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064844:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637d58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064850:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3104d6e500) 00010000:00010000:3.0:1787782883.064853:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782883.064855:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637d58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064860:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637d58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064873:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064878:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064883:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064888:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782883.064896:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064902:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064910:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef900) 00010000:00010000:3.0:1787782883.064912:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782883.064915:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.064920:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782883.065963:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f136580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+32:11548:x1874625904595200:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 2095us (2322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782883.065974:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 194 00000001:00080000:1.0:1787782883.068602:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1787782883.068631:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:0.0:1787782883.115532:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782883.115788:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904595456 00000100:00100000:2.0:1787782883.115808:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904595456 00000100:00100000:2.0:1787782883.115907:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 195 00000100:00100000:2.0:1787782883.115918:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f137c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+32:11551:x1874625904595456:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787782883.115940:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782883.115972:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637d66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e55cb expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.116057:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.116074:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.116119:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.116201:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637d74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.116209:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.116215:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.116587:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637d7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.116597:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.116605:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782883.116615:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787782883.116947:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.116956:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.116962:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.116968:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782883.116978:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.116985:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.116996:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:2.0:1787782883.116999:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782883.117003:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.117009:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637d6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.117025:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637d74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.117031:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637d74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.117036:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637d74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.117052:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782883.117055:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637d74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.117061:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637d74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.117069:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3108738300) 00010000:00010000:2.0:1787782883.117071:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782883.117082:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637d74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.117088:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637d74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.117467:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637d66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55cb expref: 35 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.117483:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637d7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55cb expref: 34 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.117490:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef900) 00010000:00010000:2.0:1787782883.117492:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787782883.117494:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204200, rc 0) 00000100:00100000:2.0:1787782883.117575:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f137c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+34:11551:x1874625904595456:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1658us (2636us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787782883.117585:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 195 00000100:00100000:1.0:1787782883.121302:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782883.121444:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904595584 00000100:00100000:3.0:1787782883.121454:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904595584 00000100:00100000:3.0:1787782883.121514:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 196 00000100:00100000:3.0:1787782883.121525:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+34:11551:x1874625904595584:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:3.0:1787782883.121594:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.121611:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637d2e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55b6 expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.121620:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d89 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.121653:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637d2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55b6 expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.121692:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637d2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55b6 expref: 34 pid: 5852 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782883.121708:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312ee730c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922416000:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787782883.121813:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787782883.126744:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782883.126924:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312ee730c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5853:1874625922416000:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787782883.126954:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782883.127223:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904595840 00000100:00100000:2.0:1787782883.127231:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904595840 00000100:00100000:2.0:1787782883.127426:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:2.0:1787782883.127437:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+35:9245:x1874625904595840:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787782883.127774:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+36:9245:x1874625904595840:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 339us (1033us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787782883.127783:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:1.0:1787782883.131361:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782883.131697:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904595968 00000100:00100000:2.0:1787782883.131708:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904595968 00010000:00010000:2.0:1787782883.131760:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637d2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55b6 expref: 36 pid: 5852 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782883.131831:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 75 00000100:00100000:2.0:1787782883.131841:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102e10050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+36:2349:x1874625904595968:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782883.131856:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782883.131863:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637d2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55b6 expref: 36 pid: 5852 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.131877:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637d2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55b6 expref: 36 pid: 5852 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.131900:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637d2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55b6 expref: 36 pid: 5852 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.131919:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef900) 00010000:00010000:2.0:1787782883.131925:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.131934:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.131942:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d89 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.131973:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782883.132026:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102e10050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+35:2349:x1874625904595968:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 186us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782883.132033:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 75 00010000:00010000:3.0:1787782883.133604:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.133617:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.133646:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.133653:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.133670:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.133677:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782883.133681:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.133688:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.133713:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef900) 00010000:00010000:3.0:1787782883.133716:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787782883.133721:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.133736:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637d89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782883.133817:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+34:11551:x1874625904595584:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 12292us (12523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782883.133826:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 196 00000100:00100000:1.0:1787782883.136409:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782883.136478:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904596224 00000100:00100000:2.0:1787782883.136495:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904596224 00000100:00100000:2.0:1787782883.136555:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:2.0:1787782883.136564:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+34:11551:x1874625904596224:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:2.0:1787782883.136809:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+35:11551:x1874625904596224:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 245us (406us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787782883.136817:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:0.0:1787782883.224835:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782883.224958:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904596480 00000100:00100000:1.0:1787782883.224969:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904596480 00000100:00100000:1.0:1787782883.225041:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 197 00000100:00100000:1.0:1787782883.225051:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f136d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+35:11562:x1874625904596480:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:1.0:1787782883.225076:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782883.225130:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637d90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e55d2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225206:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637d97 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225221:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637d97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225248:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637d97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225264:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637d9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225272:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225278:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225602:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637da5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225612:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225620:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782883.225630:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787782883.225732:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637d97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225740:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637d97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225747:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637d97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225753:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782883.225762:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637d97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225771:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637d97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225783:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782883.225786:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782883.225791:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637d97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225808:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637d97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225821:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225827:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637d9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225833:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225837:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782883.225840:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225846:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637d9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225853:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c312eeefc00) 00010000:00010000:1.0:1787782883.225855:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782883.225864:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637d9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225870:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637d9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225918:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637d90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55d2 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225931:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55d2 expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.225938:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef900) 00010000:00010000:1.0:1787782883.225940:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782883.225942:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7200, rc 0) 00000100:00100000:1.0:1787782883.226001:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f136d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+37:11562:x1874625904596480:12345-192.168.202.15@tcp:101:cat.0 Request processed in 952us (1178us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1787782883.226009:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 197 00000100:00100000:1.0:1787782883.231507:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782883.231593:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904596736 00000100:00100000:2.0:1787782883.231603:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904596736 00000100:00100000:2.0:1787782883.231661:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 54 00000100:00100000:2.0:1787782883.231672:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+37:11562:x1874625904596736:12345-192.168.202.15@tcp:35:cat.0 00000100:00100000:2.0:1787782883.231943:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+38:11562:x1874625904596736:12345-192.168.202.15@tcp:35:cat.0 Request processed in 264us (438us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787782883.232613:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 54 00000100:00100000:0.0:1787782883.286000:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782883.286090:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904596992 00000100:00100000:2.0:1787782883.286149:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904596992 00000100:00100000:2.0:1787782883.286216:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 198 00000100:00100000:2.0:1787782883.286227:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f134b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+38:11563:x1874625904596992:12345-192.168.202.15@tcp:36:rm.0 00010000:00010000:2.0:1787782883.286287:0:6719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787782883.286316:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637da5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55d2 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.286339:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b637d7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55cb expref: 37 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.286358:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637d43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55bd expref: 36 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.286387:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c312eeef900) 00010000:00010000:2.0:1787782883.286398:0:6719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782883.286419:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637db3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.286432:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637db3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.286441:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637db3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.286455:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637dba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.286462:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637dba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.286467:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637dba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.286813:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637dc1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.286822:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637dc1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.286829:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637dc1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787782883.287556:0:6719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1787782883.287570:0:6719:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367957473563ns, next at 368957470543ns, rc = 0 00010000:00010000:2.0:1787782883.287647:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637dc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287657:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637dc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287665:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637dc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287672:0:6719:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637dc8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287678:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637dc8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287684:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637dc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287700:0:6719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782883.287718:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637dc1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287723:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637dc1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287730:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637dc1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287735:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782883.287739:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637dc1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287747:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637dc1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287765:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3108738800) 00010000:00010000:2.0:1787782883.287768:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787782883.287772:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637dc1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287779:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637dc1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287811:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637db3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287817:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637db3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287822:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637db3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287827:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782883.287830:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637db3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287836:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637db3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287844:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:2.0:1787782883.287846:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787782883.287849:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637db3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.287855:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637db3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787782883.287877:0:6719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc4258a6 reply state 00000000d7a3bc87 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637dba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782883.287886:0:6719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787782883.287977:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f134b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+37:11563:x1874625904596992:12345-192.168.202.15@tcp:36:rm.0 Request processed in 1749us (1985us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787782883.287985:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 198 00010000:00010000:0.0:1787782883.288485:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782883.288493:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637dc8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.288499:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205e00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782883.288503:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637dc8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.288518:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637dc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.288526:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c3108738800) 00010000:00010000:0.0:1787782883.288529:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787782883.288532:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637dc8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.288537:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205e00/0x6d98ed19b637dc8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.288552:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782883.288553:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782883.288555:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782883.292803:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637dba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.292823:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637dba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.292830:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637dba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.292836:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782883.292841:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637dba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.292865:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637dba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.292883:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3108738300) 00010000:00010000:1.0:1787782883.292885:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782883.292890:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637dba lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.292897:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637dba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782883.360515:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782883.360623:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904597248 00000100:00100000:1.0:1787782883.360634:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904597248 00000100:00100000:1.0:1787782883.360717:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 199 00000100:00100000:1.0:1787782883.360728:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eff83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+36:11569:x1874625904597248:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787782883.360755:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782883.360785:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637dcf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e55d9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.360971:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637dd6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.360989:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637dd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.361005:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637dd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.361019:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637ddd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.361031:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.361038:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787782883.361652:0:5851:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787782883.361829:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637de4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.361840:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.361848:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.361884:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637dd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.361890:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637dd6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.361895:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637dd6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.361900:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782883.361904:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637dd6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.361911:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637dd6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.361934:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782883.361936:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782883.361940:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637dd6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.361947:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637dd6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787782883.361961:0:5851:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003ac1e2d reply state 000000009f52728a transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782883.361969:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787782883.362000:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6600/0x6d98ed19b637dcf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55d9 expref: 39 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.362013:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55d9 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.362021:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeef400) 00010000:00010000:1.0:1787782883.362023:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782883.362025:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7200, rc 0) 00000100:00100000:1.0:1787782883.362152:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eff83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+39:11569:x1874625904597248:12345-192.168.202.15@tcp:101:bash.0 Request processed in 1426us (1649us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787782883.362160:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 199 00010000:00010000:3.0:1787782883.367761:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.367781:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637ddd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.367789:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637ddd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.367804:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782883.367809:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637ddd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.367818:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637ddd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.367836:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c312eeefc00) 00010000:00010000:3.0:1787782883.367839:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782883.367844:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637ddd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.367865:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637ddd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782883.369125:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782883.369263:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904597376 00000100:00100000:2.0:1787782883.369273:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904597376 00000100:00080000:3.0:1787782883.369327:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787782883.369350:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:2.0:1787782883.369366:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312effa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2349:x1874625904597376:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787782883.369382:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782883.369401:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000de089af/0x6d98ed19b637df2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e55e0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787782883.369425:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787782883.369445:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=368s v=(0 0) 00010000:00010000:2.0:1787782883.369449:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782883.369458:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000de089af/0x6d98ed19b637df2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e0 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.369476:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000de089af/0x6d98ed19b637df2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e0 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.369501:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204400, rc 0) 00000100:00100000:2.0:1787782883.369559:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312effa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2349:x1874625904597376:12345-192.168.202.15@tcp:101:bash.0 Request processed in 200us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782883.369578:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:0.0:1787782883.375025:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782883.375291:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904597504 00000100:00100000:1.0:1787782883.375301:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904597504 00000100:00100000:1.0:1787782883.375357:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:1.0:1787782883.375367:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312effad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:11569:x1874625904597504:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787782883.375400:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782883.375418:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e55e7 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.375448:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000de089af/0x6d98ed19b637df2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e0 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.375471:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782883.375475:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782883.375479:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e7 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.375527:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000de089af/0x6d98ed19b637df2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e0 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.375540:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000de089af/0x6d98ed19b637df2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e0 expref: 7 pid: 6697 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782883.375553:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874625922416128:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782883.375660:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787782883.382964:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782883.383411:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904597632 00000100:00100000:0.0:1787782883.383421:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904597632 00010000:00010000:0.0:1787782883.383468:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000de089af/0x6d98ed19b637df2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e0 expref: 8 pid: 6697 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782883.383511:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:0.0:1787782883.383520:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2350:x1874625904597632:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782883.383540:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782883.383568:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000de089af/0x6d98ed19b637df2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e0 expref: 8 pid: 6697 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.383607:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000de089af/0x6d98ed19b637df2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e0 expref: 8 pid: 6697 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.383634:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782883.383638:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782883.383656:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e7 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.383672:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e7 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.383712:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e7 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782883.383728:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eff8780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5837:1874625922416256:192.168.202.15@tcp:105: 00000100:00100000:0.0:1787782883.383829:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31061e0600 going to sleep for 11 seconds 00010000:00010000:1.0:1787782883.384860:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000de089af/0x6d98ed19b637df2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e0 expref: 8 pid: 6697 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782883.384882:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1874625922416128:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782883.384910:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e7 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.384934:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6600, rc 0) 00000100:00100000:1.0:1787782883.384993:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312effad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:11569:x1874625904597504:12345-192.168.202.15@tcp:101:bash.0 Request processed in 9627us (9979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782883.385002:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:3.0:1787782883.409594:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782883.410416:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904597888 00000100:00100000:2.0:1787782883.410427:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904597888 00000100:00100000:2.0:1787782883.410497:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:2.0:1787782883.410508:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+38:11569:x1874625904597888:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:0.0:1787782883.410807:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eff8780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5837:1874625922416256:192.168.202.15@tcp:105: 00010000:00010000:0.0:1787782883.410833:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782883.410898:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2350:x1874625904597632:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 27378us (27954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782883.410907:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:2.0:1787782883.411294:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+39:11569:x1874625904597888:12345-192.168.202.15@tcp:35:bash.0 Request processed in 787us (1710us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787782883.411302:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 55 00000100:00100000:2.0:1787782883.677228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782883.677410:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904598016 00000100:00100000:0.0:1787782883.677424:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904598016 00000100:00100000:0.0:1787782883.677513:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 200 00000100:00100000:0.0:1787782883.677525:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+39:11585:x1874625904598016:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787782883.677581:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782883.677610:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637e00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e55ee expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.677701:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637e07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.677720:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.677917:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782883.678240:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787782883.678245:0:6719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787782883.678278:0:6719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.678317:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637e00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55ee expref: 41 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.678343:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637e07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55ee expref: 40 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.678354:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:0.0:1787782883.678357:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787782883.678362:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254200, rc 0) 00000100:00100000:0.0:1787782883.678517:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+40:11585:x1874625904598016:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 993us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782883.678527:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 200 00010000:00010000:0.0:1787782883.681743:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782883.688649:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782883.689396:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904598272 00000100:00100000:1.0:1787782883.689412:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904598272 00000100:00100000:1.0:1787782883.689497:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 201 00000100:00100000:1.0:1787782883.689510:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+40:11585:x1874625904598272:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787782883.689543:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782883.689574:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637e0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e55f5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.689713:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637e15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.689730:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.689744:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782883.689757:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787782883.689943:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637e0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55f5 expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.691338:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55f5 expref: 42 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.691382:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeef400) 00010000:00010000:1.0:1787782883.691386:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782883.691391:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7600, rc 0) 00000100:00100000:1.0:1787782883.691507:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+42:11585:x1874625904598272:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1998us (2874us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787782883.691518:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 201 00000100:00100000:1.0:1787782883.710435:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782883.710569:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782883.710688:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904598400 00000100:00100000:2.0:1787782883.710702:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904598400 00000100:00100000:2.0:1787782883.710805:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:2.0:1787782883.710818:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+42:2352:x1874625904598400:12345-192.168.202.15@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787782883.710839:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904598656 00010000:00010000:2.0:1787782883.710841:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787782883.710843:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904598656 00010000:00010000:2.0:1787782883.710876:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637e15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55f5 expref: 43 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782883.710897:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 202 00010000:00010000:2.0:1787782883.710901:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeef400) 00000100:00100000:3.0:1787782883.710904:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+42:11585:x1874625904598656:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787782883.710907:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787782883.710930:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782883.710948:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637e23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e55fc expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782883.710990:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+43:2352:x1874625904598400:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 175us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782883.710998:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00010000:00010000:3.0:1787782883.711085:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637e2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.711146:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637e2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.711159:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637e2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782883.711173:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787782883.711361:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637e23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55fc expref: 44 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.711379:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637e2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55fc expref: 43 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.711412:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeef400) 00010000:00010000:3.0:1787782883.711415:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787782883.711418:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1c00, rc 0) 00000100:00100000:3.0:1787782883.711447:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+43:11585:x1874625904598656:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 543us (878us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787782883.711453:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 202 00000100:00100000:3.0:1787782883.720591:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782883.722527:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904598784 00000100:00100000:2.0:1787782883.722547:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904598784 00000100:00100000:2.0:1787782883.722643:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:2.0:1787782883.722656:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+6:2351:x1874625904598784:12345-192.168.202.15@tcp:1:lfs.0 00010000:00010000:2.0:1787782883.722741:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c32bfde7/0x6d98ed19b637e38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.722768:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e7 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.722779:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782883.722784:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787782883.722798:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c32bfde7/0x6d98ed19b637e38 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.722848:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e7 expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.722865:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e7 expref: 6 pid: 6698 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782883.722883:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccdb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874625922416384:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787782883.723825:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311f9becc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782883.736157:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782883.740199:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904598912 00000100:00100000:3.0:1787782883.740230:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904598912 00002000:00100000:3.0:1787782883.740316:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8c313cc04f00 x1874625904598912/t0(0) o4->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:274/0 lens 504/0 e 0 to 0 dl 1787782894 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787782883.740329:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c313cc04f00 with x1874625904598912 ext(0->8) 00010000:00010000:3.0:1787782883.740341:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e7 expref: 7 pid: 6698 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.740362:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e7 expref: 7 pid: 6698 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787782883.740370:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c313cc04f00 00000100:00100000:3.0:1787782883.740418:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:3.0:1787782883.740428:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2349:x1874625904598912:12345-192.168.202.15@tcp:4:lfs.0 00000100:00100000:3.0:1787782883.741227:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2349:x1874625904598912:12345-192.168.202.15@tcp:4:lfs.0 Request processed in 796us (5141us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787782883.741238:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00002000:00100000:3.0:1787782883.741253:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8c313cc04f00 x1874625904598912/t4294967308(0) o4->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:274/0 lens 504/448 e 0 to 0 dl 1787782894 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787782883.741262:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c313cc04f00 with x1874625904598912 ext(0->8) 00010000:00010000:3.0:1787782883.741269:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e7 expref: 9 pid: 6698 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.741284:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e7 expref: 9 pid: 6698 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787782883.741292:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c313cc04f00 00000100:00100000:1.0:1787782883.742457:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccdb0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1874625922416384:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782883.742497:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c32bfde7/0x6d98ed19b637e38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782883.748721:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782883.750228:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904599040 00000100:00100000:3.0:1787782883.750249:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904599040 00010000:00010000:3.0:1787782883.750323:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e7 expref: 9 pid: 6698 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782883.750397:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:3.0:1787782883.750410:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2350:x1874625904599040:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782883.750432:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787782883.750462:0:5836:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787782883.750466:0:5836:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787782883 00002000:00010000:3.0:1787782883.750468:0:5836:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787782883 00002000:00010000:3.0:1787782883.750471:0:5836:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787782883 00010000:00010000:3.0:1787782883.750478:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e7 expref: 9 pid: 6698 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.750495:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e7 expref: 9 pid: 6698 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.750550:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ac6cd0e/0x6d98ed19b637df9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55e7 expref: 9 pid: 6698 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.750574:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787782883.750579:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787782883.750587:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c32bfde7/0x6d98ed19b637e38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.750600:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c32bfde7/0x6d98ed19b637e38 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782883.750646:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782883.750739:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2350:x1874625904599040:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 330us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782883.750748:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 77 00010000:00010000:1.0:1787782883.750971:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c32bfde7/0x6d98ed19b637e38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.750983:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c32bfde7/0x6d98ed19b637e38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.751015:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c32bfde7/0x6d98ed19b637e38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.751024:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c32bfde7/0x6d98ed19b637e38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.751048:0:6697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c32bfde7/0x6d98ed19b637e38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.751397:0:6697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205000 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782883.751403:0:6697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c32bfde7/0x6d98ed19b637e38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.751416:0:6697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c32bfde7/0x6d98ed19b637e38 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.751435:0:6697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c32bfde7/0x6d98ed19b637e38 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.751444:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c32bfde7/0x6d98ed19b637e38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782883.751520:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2351:x1874625904598784:12345-192.168.202.15@tcp:1:lfs.0 Request processed in 28865us (30942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782883.751529:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:0.0:1787782883.758513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782883.758652:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904599296 00000100:00100000:2.0:1787782883.758666:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904599296 00000100:00100000:2.0:1787782883.758749:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 56 00000100:00100000:2.0:1787782883.758762:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310619e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+43:11585:x1874625904599296:12345-192.168.202.15@tcp:35:lfs.0 00000004:00010000:2.0:1787782883.758864:0:5854:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637e2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55fc expref: 43 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787782883.759308:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1787782883.759359:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787782883.759843:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1787782883.759919:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e3f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.759942:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637de4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55d9 expref: 47 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.759954:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e3f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.760002:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55d9 expref: 47 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.760021:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637de4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55d9 expref: 47 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782883.760039:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5854:1874625922416512:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787782883.760194:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311f9be9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782883.766007:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782883.766358:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904599424 00000100:00100000:2.0:1787782883.766371:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904599424 00010000:00010000:2.0:1787782883.766432:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637de4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55d9 expref: 48 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782883.766485:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 78 00000100:00100000:2.0:1787782883.766498:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eff8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+48:2350:x1874625904599424:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782883.766544:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782883.766554:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637de4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55d9 expref: 48 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.766570:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637de4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55d9 expref: 48 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.766601:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeef400) 00010000:00010000:2.0:1787782883.766608:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e3f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.766619:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.766629:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e3f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782883.766656:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782883.766746:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eff8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+48:2350:x1874625904599424:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 251us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782883.766755:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 78 00010000:00010000:1.0:1787782883.766888:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637de4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55d9 expref: 47 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782883.766910:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd30c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5854:1874625922416512:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782883.766939:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.766959:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.766967:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787782883.767190:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787782883.767456:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1787782883.767592:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119ef4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5854:1874625922416640:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787782883.767659:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782883.767700:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9e180 going to sleep for 11 seconds 00000100:00100000:1.0:1787782883.767727:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922416640 00000100:00100000:1.0:1787782883.767732:0:12025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922416640 00000100:00100000:1.0:1787782883.767786:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787782883.767810:0:12025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310827cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5854:x1874625922416640:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787782883.767889:0:12025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310827cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5854:x1874625922416640:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782883.767896:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787782883.767927:0:5854:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1787782883.767934:0:5854:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1787782883.767953:0:5854:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c313c97f480, transno 4294967307 00000100:00100000:1.0:1787782883.767966:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119ef4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5854:1874625922416640:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1787782883.768526:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787782883.768561:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1787782883.768621:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119ef4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5854:1874625922416768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787782883.770295:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782883.770435:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9e300 going to sleep for 11 seconds 00000100:00100000:2.0:1787782883.772292:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922416768 00000100:00100000:2.0:1787782883.772310:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922416768 00000100:00100000:2.0:1787782883.772382:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787782883.772394:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3110740b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5854:x1874625922416768:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787782883.772713:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3110740b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5854:x1874625922416768:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 320us (2424us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787782883.772722:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787782883.772804:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119ef4780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5854:1874625922416768:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787782883.772913:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1787782883.772971:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e3f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.772984:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e3f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.772992:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e3f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.772998:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782883.773003:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e3f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.773012:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e3f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.773031:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeef400) 00010000:00010000:1.0:1787782883.773034:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787782883.773040:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e3f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.773047:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e3f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787782883.773327:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787782883.773481:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1787782883.773493:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 368443396493ns, next at 369443394283ns, rc = 0 00000001:00080000:1.0:1787782883.773500:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787782883.773533:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeef400) 00010000:00010000:1.0:1787782883.773545:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787782883.773554:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637e2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55fc expref: 51 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782883.773689:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310619e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+50:11585:x1874625904599296:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 14929us (15194us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1787782883.773699:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 56 00000020:00080000:1.0:1787782883.773703:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787782883.778082:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782883.782163:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904599552 00000100:00100000:2.0:1787782883.782187:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904599552 00000100:00100000:1.0:1787782883.782883:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 203 00000100:00100000:1.0:1787782883.782904:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eff92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+50:11585:x1874625904599552:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787782883.782940:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782883.782977:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637e46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5603 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.783079:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637e46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5603 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.783122:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637e46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5603 expref: 51 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.783148:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:1.0:1787782883.783152:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787782883.783157:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7200, rc 0) 00000100:00100000:1.0:1787782883.783307:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eff92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+51:11585:x1874625904599552:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 410us (5252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782883.783316:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 203 00000100:00100000:2.0:1787782883.786917:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782883.787047:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904599808 00000100:00100000:1.0:1787782883.787227:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904599808 00000100:00100000:1.0:1787782883.787398:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:1.0:1787782883.787412:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+51:11585:x1874625904599808:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787782883.787775:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+52:11585:x1874625904599808:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 365us (873us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787782883.787784:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 57 00000100:00100000:3.0:1787782883.890563:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782883.890710:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904599936 00000100:00100000:0.0:1787782883.890735:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904599936 00000100:00100000:0.0:1787782883.890825:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 204 00000100:00100000:0.0:1787782883.890837:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+52:11595:x1874625904599936:12345-192.168.202.15@tcp:34:lfs.0 00010000:00010000:0.0:1787782883.890953:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637e4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.890976:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637e4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.890990:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637e4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891010:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637e54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891017:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891024:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891216:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637e5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891225:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891256:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787782883.891314:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891331:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637e4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891338:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637e4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891346:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891352:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782883.891356:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891364:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637e4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891379:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:0.0:1787782883.891382:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782883.891388:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637e4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891395:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254e00/0x6d98ed19b637e4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891413:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637e54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891426:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637e54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891432:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637e54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891437:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782883.891441:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637e54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891447:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637e54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891456:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c310823ce00) 00010000:00010000:0.0:1787782883.891458:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782883.891461:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637e54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891467:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637e54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891482:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891488:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637e5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891494:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891499:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782883.891508:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891515:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637e5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891524:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:0.0:1787782883.891526:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782883.891529:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637e5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782883.891535:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637e5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782883.891645:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+52:11595:x1874625904599936:12345-192.168.202.15@tcp:34:lfs.0 Request processed in 808us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782883.891655:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 204 00000100:00100000:0.0:1787782883.939086:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922417280:0@lo:400:kworker.0 00000100:00100000:0.0:1787782883.939228:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782883.939326:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787782883.939333:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312effa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874625922417152:0@lo:400:kworker.0 00000100:00100000:0.0:1787782883.939362:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782883.939466:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625922417024:0@lo:400:kworker.0 00000100:00100000:3.0:1787782883.939503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782883.939539:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787782883.939546:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eff9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922416896:0@lo:400:kworker.0 00000100:00100000:3.0:1787782883.939580:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782883.939606:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31410e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922417408:0@lo:400:kworker.0 00000100:00100000:3.0:1787782883.939629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782883.939676:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922416896 00000100:00100000:3.0:1787782883.939703:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922416896 00000100:00100000:3.0:1787782883.939776:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787782883.939786:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922416896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782883.939859:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3305:x1874625922416896:12345-0@lo:400:kworker.0 Request processed in 74us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782883.939866:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787782883.939909:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922417280 00000100:00100000:3.0:1787782883.939912:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922417280 00000100:00100000:3.0:1787782883.939949:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787782883.939955:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922417280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782883.939994:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922417280:12345-0@lo:400:kworker.0 Request processed in 40us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782883.940001:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1787782883.940018:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787782883.940051:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eff9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:db359560-8e1a-42c0-a155-5e020d83d9a3:3305:1874625922416896:0@lo:400:kworker.0 00000100:00100000:3.0:1787782883.940090:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922417280:0@lo:400:kworker.0 00000100:00100000:0.0:1787782883.940386:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922417152 00000100:00100000:0.0:1787782883.940391:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922417152 00000100:00100000:0.0:1787782883.940445:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922417024 00000100:00100000:0.0:1787782883.940449:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922417024 00000100:00100000:0.0:1787782883.940464:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922417408 00000100:00100000:0.0:1787782883.940467:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922417408 00000100:00100000:0.0:1787782883.940483:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787782883.940489:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31345fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874625922417152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782883.940545:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31345fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874625922417152:12345-0@lo:400:kworker.0 Request processed in 55us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782883.940552:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787782883.940567:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787782883.940574:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625922417024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782883.940608:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625922417024:12345-0@lo:400:kworker.0 Request processed in 34us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782883.940614:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787782883.940626:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787782883.940632:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922417408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782883.940933:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922417408:12345-0@lo:400:kworker.0 Request processed in 300us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782883.940941:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:3.0:1787782883.941858:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782883.941911:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31410e4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922417408:0@lo:400:kworker.0 00000100:00100000:3.0:1787782883.941928:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625922417024:0@lo:400:kworker.0 00000100:00100000:3.0:1787782883.941990:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312effa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874625922417152:0@lo:400:kworker.0 00000100:00100000:3.0:1787782883.951246:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782883.951484:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904600192 00000100:00100000:1.0:1787782883.951497:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904600192 00000100:00100000:1.0:1787782883.951585:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 205 00000100:00100000:1.0:1787782883.951599:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+52:11598:x1874625904600192:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787782883.951628:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782883.951666:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637e62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e560a expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.951780:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637e69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.951809:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637e69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.951824:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637e69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.951842:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637e70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.951850:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.951858:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952068:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637e77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952079:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952086:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782883.952432:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787782883.952578:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637e69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952587:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637e69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952595:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637e69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952602:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782883.952607:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637e69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952615:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637e69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952630:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782883.952633:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782883.952640:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637e69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952645:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7800/0x6d98ed19b637e69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952783:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952798:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637e70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952804:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637e70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952810:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782883.952813:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637e70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952819:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637e70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952828:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c312eeef400) 00010000:00010000:1.0:1787782883.952831:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782883.952834:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637e70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952840:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7c00/0x6d98ed19b637e70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952896:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637e62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e560a expref: 55 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952913:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637e77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e560a expref: 54 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.952934:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:1.0:1787782883.952937:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782883.952939:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6c00, rc 0) 00000100:00100000:1.0:1787782883.953285:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+54:11598:x1874625904600192:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1688us (2052us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787782883.953295:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 205 00000100:00100000:3.0:1787782883.960067:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782883.960183:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904600320 00000100:00100000:1.0:1787782883.960195:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904600320 00000100:00100000:1.0:1787782883.960268:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 206 00000100:00100000:1.0:1787782883.960280:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+54:11598:x1874625904600320:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:1.0:1787782883.960384:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637e85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.960408:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.960422:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.960457:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637e85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.960465:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637e85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.960473:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637e85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.960480:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782883.960505:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637e85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.960515:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637e85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.960530:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:1.0:1787782883.960533:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787782883.960539:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637e85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782883.960545:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637e85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782883.962162:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+54:11598:x1874625904600320:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 1865us (2092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782883.962181:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 206 00000100:00100000:3.0:1787782883.965349:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782883.965444:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904600576 00000100:00100000:1.0:1787782883.965458:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904600576 00000100:00100000:1.0:1787782883.965537:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 58 00000100:00100000:1.0:1787782883.965550:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+54:11598:x1874625904600576:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787782883.965907:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+55:11598:x1874625904600576:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 358us (964us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787782883.965916:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 58 00000040:00080000:2.0:1787782884.001632:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787782884.001645:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787782884.001700:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787782884.001709:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787782884.046631:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782884.046896:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904600832 00000100:00100000:2.0:1787782884.046910:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904600832 00000100:00100000:2.0:1787782884.047020:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 207 00000100:00100000:2.0:1787782884.047033:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f38b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+55:11608:x1874625904600832:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787782884.047064:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782884.047069:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787782884.047148:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637e07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55ee expref: 55 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.047173:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:2.0:1787782884.047179:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782884.047198:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5611 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.047334:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b637e93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.047350:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637e77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e560a expref: 55 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.047359:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b637e93 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.047421:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637e77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e560a expref: 55 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.047436:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637e77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e560a expref: 55 pid: 6719 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782884.047454:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2cb840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1874625922417536:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787782884.047581:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311f9becc0 going to sleep for 11 seconds 00000100:00080000:3.0:1787782884.049817:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782884.053078:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782884.053413:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2cb840 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1874625922417536:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782884.053453:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b637e93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782884.053668:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904600960 00000100:00100000:3.0:1787782884.053696:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904600960 00010000:00010000:3.0:1787782884.053756:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637e77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e560a expref: 56 pid: 6719 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782884.053803:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:3.0:1787782884.053815:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+56:2350:x1874625904600960:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782884.053836:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782884.053845:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637e77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e560a expref: 56 pid: 6719 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.053859:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637e77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e560a expref: 56 pid: 6719 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.053887:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637e77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e560a expref: 56 pid: 6719 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.053905:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:3.0:1787782884.053910:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b637e93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.053919:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b637e93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.053927:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b637e93 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.053969:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782884.054049:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+55:2350:x1874625904600960:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 235us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782884.054068:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 79 00010000:00010000:1.0:1787782884.054326:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b637e93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782884.054342:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b637e93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782884.054370:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787782884.054596:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b637e8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5611 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782884.054624:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b637e93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5611 expref: 55 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782884.054632:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:1.0:1787782884.054634:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787782884.054637:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204000, rc 0) 00000100:00100000:1.0:1787782884.054688:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f38b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+55:11608:x1874625904600832:12345-192.168.202.15@tcp:101:bash.0 Request processed in 7659us (8076us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787782884.054696:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 207 00000100:00100000:0.0:1787782884.066982:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782884.067962:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904601216 00000100:00100000:2.0:1787782884.067983:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904601216 00000100:00100000:2.0:1787782884.068084:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 208 00000100:00100000:2.0:1787782884.068142:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+55:11608:x1874625904601216:12345-192.168.202.15@tcp:36:bash.0 00010000:00010000:2.0:1787782884.068496:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b637ea1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.068518:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b637ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.068849:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b637ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787782884.068923:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1787782884.068951:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2fb311b reply state 000000005a596022 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b637ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782884.068963:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787782884.069135:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+58:11608:x1874625904601216:12345-192.168.202.15@tcp:36:bash.0 Request processed in 1040us (2170us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787782884.069163:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 208 00000020:00080000:2.0:1787782884.069169:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787782884.077448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782884.077937:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904601344 00000100:00100000:2.0:1787782884.077953:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904601344 00000100:00100000:2.0:1787782884.078038:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 209 00000100:00100000:2.0:1787782884.078050:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f389e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+58:11608:x1874625904601344:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787782884.078089:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782884.078372:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637ea8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5618 expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.078491:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.078510:0:6719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b637e93 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5611 expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.078519:0:6719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b637ea1 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.078526:0:6719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.078868:0:6719:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b637ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.078906:0:6719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b637e93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5611 expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.078925:0:6719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b637e93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5611 expref: 59 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782884.078968:0:6719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2c9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6719:1874625922417664:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787782884.079266:0:6719:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311f9be240 going to sleep for 11 seconds 00010000:00010000:1.0:1787782884.080298:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b637ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782884.080313:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b637ea1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782884.080320:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b637ea1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782884.080327:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782884.080332:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b637ea1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782884.080363:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b637ea1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782884.080384:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:1.0:1787782884.080388:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782884.080392:0:3291:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782884.080402:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b637ea1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782884.080409:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b637ea1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782884.087022:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782884.087570:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904601472 00000100:00100000:3.0:1787782884.087582:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904601472 00010000:00010000:3.0:1787782884.087639:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b637e93 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5611 expref: 59 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782884.087694:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:3.0:1787782884.087706:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+59:2349:x1874625904601472:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782884.087734:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782884.087743:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b637e93 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5611 expref: 59 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.087759:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b637e93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5611 expref: 59 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.087799:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:3.0:1787782884.087805:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.087818:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.087827:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.087850:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782884.087926:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+59:2349:x1874625904601472:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 221us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782884.088603:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 80 00010000:00010000:1.0:1787782884.089849:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b637e93 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5611 expref: 58 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782884.089882:0:6719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2c9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6719:1874625922417664:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782884.089915:0:6719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.090088:0:6719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.090387:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782884.090457:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787782884.090462:0:6719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787782884.090488:0:6719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.090614:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205200/0x6d98ed19b637ea8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5618 expref: 58 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.091065:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5618 expref: 57 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.091078:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:0.0:1787782884.091082:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787782884.091086:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204400, rc 0) 00000100:00100000:0.0:1787782884.091378:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f389e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+57:11608:x1874625904601344:12345-192.168.202.15@tcp:101:bash.0 Request processed in 13328us (13945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782884.091389:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 209 00000100:00100000:2.0:1787782884.104623:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782884.104709:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904601728 00000100:00100000:1.0:1787782884.104733:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904601728 00000100:00100000:1.0:1787782884.104833:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:1.0:1787782884.104845:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+57:11608:x1874625904601728:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:1.0:1787782884.105923:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+58:11608:x1874625904601728:12345-192.168.202.15@tcp:35:bash.0 Request processed in 1073us (1308us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1787782884.105935:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 59 00000100:00100000:2.0:1787782884.164408:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782884.164525:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904601856 00000100:00100000:1.0:1787782884.164538:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904601856 00000100:00100000:1.0:1787782884.164805:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 210 00000100:00100000:1.0:1787782884.164830:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+58:11614:x1874625904601856:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787782884.164863:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782884.164889:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637eb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e561f expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782884.164965:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637ebd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782884.164983:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782884.164996:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782884.165090:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787782884.165202:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782884.165279:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.165314:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6a00/0x6d98ed19b637eb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e561f expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.165337:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e561f expref: 59 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.165346:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:2.0:1787782884.165350:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787782884.165354:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7000, rc 0) 00000100:00100000:2.0:1787782884.165443:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+59:11614:x1874625904601856:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 624us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782884.165452:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 210 00000100:00100000:0.0:1787782884.170512:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782884.170605:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904601984 00000100:00100000:3.0:1787782884.170617:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904601984 00000100:00100000:3.0:1787782884.170701:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 211 00000100:00100000:3.0:1787782884.170710:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+59:11614:x1874625904601984:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787782884.170740:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782884.170762:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637ec4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5626 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.170866:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637ecb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.170885:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637ecb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.170898:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637ecb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.170915:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ed2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.170921:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.170925:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171268:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ed9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171295:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171300:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782884.171340:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787782884.171344:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787782884.171362:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171372:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171380:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637ecb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171385:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637ecb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171389:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637ecb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171393:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782884.171397:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637ecb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171403:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637ecb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171414:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:3.0:1787782884.171416:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782884.171425:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637ecb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171429:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637ecb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171441:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171446:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ed2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171449:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171452:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782884.171454:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171457:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ed2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171461:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c3104d6e500) 00010000:00010000:3.0:1787782884.171462:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782884.171463:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ed2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171466:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637ed2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171494:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637ec4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5626 expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171515:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5626 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.171520:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:3.0:1787782884.171522:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787782884.171534:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0600, rc 0) 00000100:00100000:3.0:1787782884.171634:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+60:11614:x1874625904601984:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 926us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782884.171641:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 211 00000100:00100000:3.0:1787782884.174558:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782884.174678:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904602240 00000100:00100000:2.0:1787782884.174691:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904602240 00000100:00100000:2.0:1787782884.174774:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 212 00000100:00100000:2.0:1787782884.174803:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+60:11614:x1874625904602240:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787782884.175321:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782884.175361:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637ee0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e562d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.175478:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.175493:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5618 expref: 61 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.175499:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ed9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5626 expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.175506:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.175543:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5626 expref: 61 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.175555:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ed9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5626 expref: 61 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782884.175567:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2c92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922417792:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787782884.175689:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5618 expref: 61 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.175698:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5618 expref: 61 pid: 6719 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782884.175708:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2ca580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922417920:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787782884.175746:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311f9be9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782884.176004:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782884.176666:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904602368 00000100:00100000:3.0:1787782884.176676:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904602368 00010000:00010000:3.0:1787782884.176717:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ed9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5626 expref: 62 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782884.176813:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:3.0:1787782884.176831:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102e12050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+62:2349:x1874625904602368:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782884.176844:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782884.176851:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ed9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5626 expref: 62 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.176864:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ed9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5626 expref: 62 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.176888:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:3.0:1787782884.176905:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.176914:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782884.176921:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782884.176963:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102e12050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+62:2349:x1874625904602368:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 133us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782884.176971:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 81 00010000:00010000:0.0:1787782884.179322:0:5852:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.15@tcp) returned -22 from blocking AST (req@000000006320201e x1874625922417792) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ed9 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5626 expref: 61 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.179356:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0600/0x6d98ed19b637ed9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5626 expref: 61 pid: 5851 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782884.179376:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2c92c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922417792:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787782884.179394:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2ca580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922417920:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787782884.179423:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:0.0:1787782884.179428:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.179437:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.179470:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782884.181378:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782884.181483:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904602496 00000100:00100000:2.0:1787782884.181496:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904602496 00010000:00010000:2.0:1787782884.181549:0:7637:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5618 expref: 61 pid: 6719 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782884.181625:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:2.0:1787782884.181634:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+61:2349:x1874625904602496:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782884.181649:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782884.181657:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5618 expref: 61 pid: 6719 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.181670:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5618 expref: 61 pid: 6719 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.181697:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637eaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5618 expref: 61 pid: 6719 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.181721:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:2.0:1787782884.181727:0:7637:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.181737:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.181746:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.181779:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787782884.181888:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.181894:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782884.181916:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787782884.182164:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637ee0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e562d expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.182182:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e562d expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.182189:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:0.0:1787782884.182192:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787782884.182195:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141205c00, rc 0) 00000100:00100000:0.0:1787782884.182251:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+61:11614:x1874625904602240:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 7469us (7709us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787782884.182259:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 212 00000100:00100000:2.0:1787782884.182530:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+60:2349:x1874625904602496:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 895us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782884.182538:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:0.0:1787782884.185765:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782884.185953:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904602752 00000100:00100000:1.0:1787782884.185968:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904602752 00000100:00100000:1.0:1787782884.186061:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:1.0:1787782884.186074:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+60:11614:x1874625904602752:12345-192.168.202.15@tcp:103:lfs.0 00010000:00010000:1.0:1787782884.186120:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782884.186154:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637e46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5603 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782884.186178:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:1.0:1787782884.186185:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782884.186279:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+59:11614:x1874625904602752:12345-192.168.202.15@tcp:103:lfs.0 Request processed in 208us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782884.186288:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:0.0:1787782884.189881:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782884.190207:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904602880 00000100:00100000:2.0:1787782884.190220:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904602880 00000100:00100000:2.0:1787782884.190344:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 213 00000100:00100000:2.0:1787782884.190354:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+59:11614:x1874625904602880:12345-192.168.202.15@tcp:58:lfs.0 00010000:00010000:2.0:1787782884.190475:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ef5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.190492:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ef5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782884.190504:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ef5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787782884.190778:0:6719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787782884.190970:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+59:11614:x1874625904602880:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 615us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782884.190980:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 213 00000100:00100000:2.0:1787782884.194515:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782884.195255:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904603008 00000100:00100000:0.0:1787782884.195274:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904603008 00000100:00100000:0.0:1787782884.195360:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 214 00000100:00100000:0.0:1787782884.195394:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+59:11614:x1874625904603008:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787782884.195424:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782884.195456:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637efc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5634 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.195535:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ef5 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.195549:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637efc lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5634 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.195572:0:5853:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ef5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.195588:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637efc lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5634 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.195605:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:0.0:1787782884.195608:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787782884.195612:0:5853:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637efc lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5634 expref: 60 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782884.195621:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255200, rc 0) 00000100:00100000:0.0:1787782884.195695:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+60:11614:x1874625904603008:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 305us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782884.195703:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 214 00000100:00100000:3.0:1787782884.450457:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c314117de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922418048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782884.450581:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782884.450669:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922418048 00000100:00100000:0.0:1787782884.450681:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922418048 00000100:00100000:0.0:1787782884.450773:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787782884.450793:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625922418048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787782884.450833:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782884.450899:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625922418048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782884.450922:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000004:00080000:1.0:1787782884.451032:0:6959:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 369120935006ns, next at 370120931915ns, rc = 0 00000100:00100000:3.0:1787782884.451366:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787782884.451379:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccdb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922418176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782884.451415:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782884.451596:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c314117de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922418048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782884.453222:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922418176 00000100:00100000:1.0:1787782884.453238:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922418176 00000100:00100000:1.0:1787782884.453316:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787782884.453326:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922418176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782884.453376:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782884.453476:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922418176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (2059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782884.453485:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787782884.453991:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccdb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922418176:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787782884.705705:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787782885.029623:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787782885.029638:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787782885.029708:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787782885.029717:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787782885.029917:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2c92c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874625922418304:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787782885.030129:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311f9becc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782885.035245:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2c92c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874625922418304:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787782885.039768:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782885.039933:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904603136 00000100:00100000:3.0:1787782885.039959:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904603136 00000100:00100000:3.0:1787782885.040039:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 215 00000100:00100000:3.0:1787782885.040051:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+60:11615:x1874625904603136:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787782885.040172:0:5851:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787782885.040399:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+60:11615:x1874625904603136:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 349us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782885.040408:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 215 00000100:00100000:2.0:1787782885.051728:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782885.051915:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904603264 00000100:00100000:0.0:1787782885.051927:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904603264 00000100:00100000:0.0:1787782885.052012:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 216 00000100:00100000:0.0:1787782885.052024:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+60:11615:x1874625904603264:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787782885.052156:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f03 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.052178:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.052194:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.054758:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f0a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.054794:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.054809:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.054857:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.054889:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.054897:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782885.054947:0:5853:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787782885.054952:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787782885.054967:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.054979:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.054985:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f03 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.054993:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f03 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.054998:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782885.055002:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f03 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055008:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f03 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055021:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c312eeef700) 00010000:00010000:0.0:1787782885.055024:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782885.055029:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f03 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055048:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f03 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055610:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055619:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f0a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055626:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055632:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782885.055635:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055642:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f0a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055654:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8c310823ce00) 00010000:00010000:0.0:1787782885.055657:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782885.055660:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f0a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055667:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f0a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055684:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055691:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055705:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055711:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782885.055714:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055721:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055729:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:0.0:1787782885.055732:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782885.055735:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.055742:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782885.055861:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+60:11615:x1874625904603264:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 Request processed in 3834us (4151us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782885.055871:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 216 00000100:00100000:0.0:1787782885.059001:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782885.061069:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904603520 00000100:00100000:3.0:1787782885.061091:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904603520 00000100:00100000:3.0:1787782885.062003:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 217 00000100:00100000:3.0:1787782885.062037:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+60:11615:x1874625904603520:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787782885.062066:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782885.062114:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637f18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e563b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.062244:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.062262:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.062276:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782885.062290:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787782885.062421:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.062430:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.062437:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.062444:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782885.062449:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.062457:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.062471:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:3.0:1787782885.062482:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787782885.062489:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.062495:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.062548:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637f18 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e563b expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.062562:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c312eeef700) 00010000:00010000:3.0:1787782885.062564:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787782885.062568:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637f18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e563b expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.062579:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1e00, rc 0) 00000100:00100000:3.0:1787782885.063945:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+61:11615:x1874625904603520:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 1899us (4948us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1787782885.064025:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 217 00000100:00100000:1.0:1787782885.073358:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782885.073490:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904603648 00000100:00100000:2.0:1787782885.073503:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904603648 00000100:00100000:2.0:1787782885.073614:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 218 00000100:00100000:2.0:1787782885.073627:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+61:11615:x1874625904603648:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787782885.073691:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787782885.074365:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+61:11615:x1874625904603648:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 737us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782885.074376:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 218 00000100:00100000:1.0:1787782885.080046:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782885.081474:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904603904 00000100:00100000:0.0:1787782885.081492:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904603904 00000100:00100000:0.0:1787782885.081577:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 219 00000100:00100000:0.0:1787782885.081591:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+61:11615:x1874625904603904:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787782885.081621:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782885.081625:0:5853:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787782885.081673:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637ebd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e561f expref: 61 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.081910:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:0.0:1787782885.081918:0:5853:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787782885.081938:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5642 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787782885.083565:0:5853:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1787782885.084213:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.084236:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.084250:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.084342:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5642 expref: 63 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.084367:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5642 expref: 62 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.084379:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c310823ce00) 00010000:00010000:0.0:1787782885.084382:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787782885.084387:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255c00, rc 0) 00000100:00100000:0.0:1787782885.084479:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+62:11615:x1874625904603904:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 2891us (4451us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1787782885.084491:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 219 00000100:00100000:0.0:1787782885.090422:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782885.090520:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904604160 00000100:00100000:3.0:1787782885.090534:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904604160 00000100:00100000:3.0:1787782885.090608:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 220 00000100:00100000:3.0:1787782885.090621:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+62:11615:x1874625904604160:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787782885.090707:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782885.090757:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5642 expref: 62 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.090794:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c310823ce00) 00010000:00010000:3.0:1787782885.090829:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787782885.090859:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637f42 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.090877:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637f42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.090890:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637f42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.090907:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe11fd1a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.090915:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe11fd1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.090922:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe11fd1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.091033:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637f42 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.091041:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637f42 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.091048:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637f42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.091055:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782885.091060:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637f42 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.091069:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637f42 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.091086:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:3.0:1787782885.091088:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782885.091363:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637f42 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.091373:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b637f42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.091386:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe11fd1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.091393:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe11fd1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.091399:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe11fd1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.091405:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782885.091408:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe11fd1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.091415:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe11fd1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.091422:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe11fd1a (ffff8c3104d6e500) 00010000:00010000:3.0:1787782885.091425:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782885.091429:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe11fd1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.091434:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe11fd1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782885.091549:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+61:11615:x1874625904604160:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 930us (1142us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787782885.091557:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 220 00000100:00100000:1.0:1787782885.095433:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782885.095560:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904604288 00000100:00100000:2.0:1787782885.095574:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904604288 00000100:00100000:2.0:1787782885.095654:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 221 00000100:00100000:2.0:1787782885.095665:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+61:11615:x1874625904604288:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787782885.095692:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782885.095738:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637f50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5649 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.095909:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637f57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.095927:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.095940:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.096387:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b637f50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5649 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.096425:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637f57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5649 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.096434:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3108738000) 00010000:00010000:2.0:1787782885.096437:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787782885.096441:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141205600, rc 0) 00000100:00100000:2.0:1787782885.096625:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+62:11615:x1874625904604288:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 961us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782885.096635:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 221 00000100:00100000:2.0:1787782885.101601:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782885.102285:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904604544 00000100:00100000:0.0:1787782885.102299:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904604544 00000100:00100000:0.0:1787782885.102380:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 222 00000100:00100000:0.0:1787782885.102391:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+62:11615:x1874625904604544:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787782885.102512:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.102534:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.102548:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787782885.103351:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1787782885.103485:0:5853:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f70256c reply state 0000000070228170 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782885.103498:0:5853:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787782885.103642:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+64:11615:x1874625904604544:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 1249us (2052us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787782885.103651:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 222 00010000:00010000:3.0:1787782885.106832:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.106857:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.106866:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.106874:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782885.106880:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.106889:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.106910:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3108738000) 00010000:00010000:3.0:1787782885.106914:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787782885.106921:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.106928:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637f5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782885.109060:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782885.109384:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904604672 00000100:00100000:3.0:1787782885.109397:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904604672 00000100:00100000:3.0:1787782885.109473:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 223 00000100:00100000:3.0:1787782885.109507:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+63:11615:x1874625904604672:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787782885.109542:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782885.109570:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5650 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.109651:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5650 expref: 64 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.109667:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5650 expref: 64 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.109692:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3108738000) 00010000:00010000:3.0:1787782885.109695:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787782885.109700:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1c00, rc 0) 00000100:00100000:3.0:1787782885.109797:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+64:11615:x1874625904604672:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 291us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782885.109806:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 223 00000100:00100000:0.0:1787782885.115671:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782885.115907:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904604800 00000100:00100000:3.0:1787782885.115921:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904604800 00000100:00100000:3.0:1787782885.116029:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:3.0:1787782885.116040:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2349:x1874625904604800:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787782885.116301:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787782885.116877:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+10:2349:x1874625904604800:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 835us (1232us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787782885.116888:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:1.0:1787782885.120309:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782885.120422:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904605056 00000100:00100000:3.0:1787782885.120435:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904605056 00000100:00100000:3.0:1787782885.120564:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:3.0:1787782885.120577:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+64:11615:x1874625904605056:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787782885.121158:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+65:11615:x1874625904605056:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 520us (802us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787782885.121169:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 60 00000100:00100000:2.0:1787782885.124570:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782885.124726:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904605312 00000100:00100000:1.0:1787782885.124739:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904605312 00000100:00100000:1.0:1787782885.124966:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 224 00000100:00100000:1.0:1787782885.124979:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+65:11615:x1874625904605312:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787782885.125179:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2cb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+65:11615:x1874625904605312:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 203us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782885.125187:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 224 00000100:00100000:3.0:1787782885.127603:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782885.128580:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904605440 00000100:00100000:0.0:1787782885.128595:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904605440 00000100:00100000:0.0:1787782885.128692:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 225 00000100:00100000:0.0:1787782885.128912:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eff8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+65:11615:x1874625904605440:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787782885.128957:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782885.129006:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5657 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.129311:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.129331:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.129345:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787782885.129394:0:5853:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787782885.129418:0:5853:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.129452:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637f6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5657 expref: 67 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.129474:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5657 expref: 66 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.129483:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3108738000) 00010000:00010000:0.0:1787782885.129487:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787782885.129491:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254600, rc 0) 00000100:00100000:0.0:1787782885.130320:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eff8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+66:11615:x1874625904605440:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 1612us (2723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782885.130330:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 225 00000100:00100000:0.0:1787782885.133982:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782885.134058:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904605568 00000100:00100000:3.0:1787782885.134070:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904605568 00000100:00100000:3.0:1787782885.134171:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:3.0:1787782885.134182:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c314117de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+10:2352:x1874625904605568:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787782885.134205:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782885.134230:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b637f7a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e565e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787782885.134264:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f66e5, blocks: 0x1 00010000:00010000:3.0:1787782885.134291:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1787782885.134297:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782885.134310:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b637f7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e565e expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.134333:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b637f7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e565e expref: 11 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.134351:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1e00, rc 0) 00000100:00100000:3.0:1787782885.134973:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c314117de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+11:2352:x1874625904605568:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 790us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782885.135004:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:2.0:1787782885.138575:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782885.138877:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904605824 00000100:00100000:3.0:1787782885.138890:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904605824 00000100:00100000:3.0:1787782885.139075:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 226 00000100:00100000:3.0:1787782885.139089:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+66:11615:x1874625904605824:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787782885.139361:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+66:11615:x1874625904605824:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 274us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782885.139369:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 226 00000100:00100000:0.0:1787782885.142512:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782885.142850:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904605952 00000100:00100000:1.0:1787782885.142869:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904605952 00000100:00100000:1.0:1787782885.143025:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:1.0:1787782885.143038:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3108268780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+11:11615:x1874625904605952:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787782885.143067:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782885.143183:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b637f81 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5665 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.143230:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b637f7a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e565e expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.143241:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782885.143245:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782885.143251:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b637f81 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5665 expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.143294:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b637f7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e565e expref: 12 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.143311:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b637f7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e565e expref: 12 pid: 6696 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782885.143327:0:6697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874625922418432:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782885.143526:0:6697:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787782885.147360:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782885.147492:0:6697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16f840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1874625922418432:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782885.147540:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b637f81 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5665 expref: 12 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.147595:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6c00, rc 0) 00000100:00100000:1.0:1787782885.147683:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3108268780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+12:11615:x1874625904605952:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 4646us (5186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782885.147694:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:3.0:1787782885.148014:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904606080 00000100:00100000:3.0:1787782885.148022:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904606080 00010000:00010000:3.0:1787782885.148066:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b637f7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e565e expref: 12 pid: 6696 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782885.148242:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 83 00000100:00100000:2.0:1787782885.148255:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+12:2349:x1874625904606080:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782885.148274:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782885.148303:0:7637:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b637f7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e565e expref: 12 pid: 6696 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.148317:0:7637:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b637f7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e565e expref: 12 pid: 6696 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.148348:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddad2e58/0x6d98ed19b637f7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e565e expref: 12 pid: 6696 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.148381:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782885.148386:0:7637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782885.148396:0:7637:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b637f81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5665 expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.148407:0:7637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b637f81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5665 expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.148450:0:7637:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b637f81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5665 expref: 11 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782885.148466:0:7637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31342fd680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7637:1874625922418560:192.168.202.15@tcp:105: 00000100:00100000:2.0:1787782885.148550:0:7637:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311f9be240 going to sleep for 11 seconds 00000100:00100000:0.0:1787782885.152980:0:7637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31342fd680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7637:1874625922418560:192.168.202.15@tcp:105: 00010000:00010000:0.0:1787782885.153020:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782885.153480:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+11:2349:x1874625904606080:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 5225us (6133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782885.153493:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 83 00000100:00100000:1.0:1787782885.157574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782885.157682:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904606208 00000100:00100000:3.0:1787782885.157694:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904606208 00002000:00100000:3.0:1787782885.157926:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8c312f16f840 x1874625904606208/t0(0) o4->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:276/0 lens 504/0 e 0 to 0 dl 1787782896 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787782885.157939:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c312f16f840 with x1874625904606208 ext(0->12) 00002000:00010000:3.0:1787782885.158021:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c312f16f840 00000100:00100000:3.0:1787782885.158067:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:3.0:1787782885.158079:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+11:2349:x1874625904606208:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787782885.159550:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+13:2349:x1874625904606208:12345-192.168.202.15@tcp:4:lhsmtool_posix.0 Request processed in 1461us (1980us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787782885.159566:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00002000:00100000:2.0:1787782885.159579:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8c312f16f840 x1874625904606208/t4294967320(0) o4->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:276/0 lens 504/448 e 0 to 0 dl 1787782896 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787782885.159590:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c312f16f840 with x1874625904606208 ext(0->12) 00002000:00010000:2.0:1787782885.159595:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c312f16f840 00000100:00100000:2.0:1787782885.162891:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782885.163186:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904606336 00000100:00100000:0.0:1787782885.163199:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904606336 00000100:00100000:0.0:1787782885.163314:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 227 00000100:00100000:0.0:1787782885.163327:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+66:11615:x1874625904606336:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787782885.225663:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:3.0:1787782885.225699:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000004:00080000:3.0:1787782885.225736:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1787782885.225756:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c3106b9e180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787782885.225796:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c311f97a400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c3106b9e000 00000020:00080000:3.0:1787782885.225800:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c311f97ac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c3001c00c00 00000004:00080000:3.0:1787782885.225856:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:3.0:1787782885.225883:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:3.0:1787782885.225896:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c312eca7f00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787782885.225899:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c3105326200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c312eca7540 00000020:00080000:3.0:1787782885.225903:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c3105326300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c313c807000 00000020:00080000:3.0:1787782885.226287:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787782885.226495:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787782885.226520:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312effa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922418688:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787782885.226613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782885.227877:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922418688 00000100:00100000:3.0:1787782885.227893:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922418688 00000100:00100000:3.0:1787782885.228150:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787782885.228163:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922418688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787782885.228203:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1787782885.228246:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f66e3, atime: 0x6a8f66e3, ctime: 0x6a8f66e3, blocks: 0x1 00010000:00010000:3.0:1787782885.228256:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b637f88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.228278:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1787782885.228283:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782885.228290:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b637f88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.228310:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b637f88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.228339:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b637f88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.228347:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b637f88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.228370:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787782885.229043:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922418816:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787782885.229158:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782885.229628:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+20:11615:x1874625904606336:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 Request processed in 66299us (66750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782885.229667:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 227 00000100:00100000:3.0:1787782885.230523:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1874625922418688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2362us (3907us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787782885.230534:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787782885.230558:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922418816 00000100:00100000:3.0:1787782885.230566:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922418816 00000100:00100000:3.0:1787782885.230616:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787782885.230625:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625922418816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787782885.233727:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1787782885.233884:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637f8f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.233915:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000043d62bb5/0x6d98ed19b637d4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55c4 expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.233925:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787782885.233930:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787782885.233936:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637f8f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.234064:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000043d62bb5/0x6d98ed19b637d4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55c4 expref: 12 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.234082:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000043d62bb5/0x6d98ed19b637d4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55c4 expref: 12 pid: 6698 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782885.234123:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eff9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874625922418944:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787782885.234580:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c313455d0c0 going to sleep for 11 seconds 00000100:00080000:3.0:1787782885.234607:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787782885.234613:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787782885.234635:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782885.234653:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b637f88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.234664:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1600 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787782885.234669:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b637f88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.234681:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b637f88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.234911:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b637f88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.234922:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b637f88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.234976:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782885.234979:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782885.234981:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787782885.235048:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c312effa1c0/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787782885.235058:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312effa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922418688:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787782885.236408:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782885.236579:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904606464 00000100:00100000:3.0:1787782885.236590:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904606464 00000100:00100000:3.0:1787782885.236667:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:3.0:1787782885.236679:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+13:2350:x1874625904606464:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787782885.243313:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782885.243360:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904606592 00000100:00100000:0.0:1787782885.243372:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904606592 00010000:00010000:0.0:1787782885.243425:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000043d62bb5/0x6d98ed19b637d4a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55c4 expref: 14 pid: 6698 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782885.243470:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:0.0:1787782885.243481:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+14:2350:x1874625904606592:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782885.243502:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782885.243510:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000043d62bb5/0x6d98ed19b637d4a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55c4 expref: 14 pid: 6698 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.243526:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000043d62bb5/0x6d98ed19b637d4a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55c4 expref: 14 pid: 6698 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.243583:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787782885.243589:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787782885.243596:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.243609:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637f8f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.243635:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782885.243720:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+14:2350:x1874625904606592:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 239us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782885.243729:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 84 00010000:00010000:2.0:1787782885.247330:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043d62bb5/0x6d98ed19b637d4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.15@tcp remote: 0x7f762009527e55c4 expref: 13 pid: 6698 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782885.247360:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eff9a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874625922418944:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787782885.247394:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.247407:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.247414:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.247427:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.247435:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.247460:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787782885.248571:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1874625922418816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17942us (19408us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787782885.248585:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:0.0:1787782885.249177:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782885.249189:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.249204:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0000 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782885.249210:0:6712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.249221:0:6712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637f8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.249248:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637f8f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.249276:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ace152e/0x6d98ed19b637f8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.249302:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782885.249304:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782885.249306:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787782885.250887:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c313c97f480/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787782885.250936:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922418816:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1787782885.290149:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1787782885.290177:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:3.0:1787782885.290185:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:3.0:1787782885.290191:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:0.0:1787782885.290419:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2350:x1874625904606464:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 Request processed in 53731us (54010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782885.290434:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:0.0:1787782885.294217:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782885.294328:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904606848 00000100:00100000:1.0:1787782885.294341:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904606848 00000100:00100000:1.0:1787782885.294448:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 228 00000100:00100000:1.0:1787782885.294461:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+20:11615:x1874625904606848:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787782885.294537:0:6719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782885.294576:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b637f73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5657 expref: 20 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.294600:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3108738000) 00010000:00010000:1.0:1787782885.294606:0:6719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787782885.294659:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637f96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.294676:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.294687:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787782885.295335:0:6719:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdc65dab reply state 00000000c3fbd709 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782885.295369:0:6719:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787782885.295513:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+21:11615:x1874625904606848:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 1052us (1309us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787782885.295522:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 228 00000100:00100000:2.0:1787782885.299254:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782885.299389:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904606976 00000100:00100000:0.0:1787782885.299404:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904606976 00000100:00100000:0.0:1787782885.299475:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:0.0:1787782885.299489:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2349:x1874625904606976:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787782885.299891:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787782885.299897:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787782884 00002000:00010000:0.0:1787782885.299900:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787782883 00002000:00010000:0.0:1787782885.299902:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787782885 -> 1787782884 00002000:00010000:0.0:1787782885.299905:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787782885.300143:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2349:x1874625904606976:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 654us (900us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787782885.300154:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 68 00010000:00010000:3.0:1787782885.303354:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.303379:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637f96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.303389:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637f96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.303397:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782885.303403:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637f96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.303413:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637f96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.303461:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3108738000) 00010000:00010000:3.0:1787782885.303465:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787782885.303473:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637f96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.303481:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637f96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782885.303621:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782885.303907:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904607232 00000100:00100000:3.0:1787782885.303920:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904607232 00000100:00100000:3.0:1787782885.304137:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 229 00000100:00100000:3.0:1787782885.304148:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+20:11615:x1874625904607232:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787782885.304235:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637f9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.304253:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637f57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5649 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.304264:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637f9d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.304308:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637f57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5649 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.304325:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637f57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5649 expref: 20 pid: 5852 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782885.304344:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312eff9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1874625922419072:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787782885.304488:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3109a37840 going to sleep for 11 seconds 00000100:00100000:0.0:1787782885.308089:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782885.308237:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904607360 00000100:00100000:1.0:1787782885.308248:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904607360 00010000:00010000:1.0:1787782885.308305:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637f57 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5649 expref: 21 pid: 5852 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782885.308345:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:1.0:1787782885.308356:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+21:2350:x1874625904607360:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782885.308377:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782885.308385:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637f57 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5649 expref: 21 pid: 5852 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.308399:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637f57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5649 expref: 21 pid: 5852 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.308428:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3108738000) 00010000:00010000:1.0:1787782885.308435:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637f9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.308447:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.308457:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637f9d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.308503:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782885.308579:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+21:2350:x1874625904607360:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 225us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782885.308588:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 85 00010000:00010000:3.0:1787782885.308950:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205600/0x6d98ed19b637f57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5649 expref: 20 pid: 5852 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782885.308977:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312eff9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5851:1874625922419072:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787782885.309006:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.309017:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.309023:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.309062:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.309070:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637f9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.309078:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.309085:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782885.309090:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.309123:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637f9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.309135:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3108738000) 00010000:00010000:3.0:1787782885.309147:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787782885.309152:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637f9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.309160:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637f9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782885.309212:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+19:11615:x1874625904607232:12345-192.168.202.15@tcp:55:lhsmtool_posix.0 Request processed in 5066us (5597us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787782885.309223:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 229 00000100:00100000:0.0:1787782885.313464:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782885.313598:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904607488 00000100:00100000:3.0:1787782885.313611:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904607488 00000100:00100000:3.0:1787782885.313887:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:3.0:1787782885.313900:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2351:x1874625904607488:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787782885.314301:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df1ba030/0x6d98ed19b637fa4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.314329:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b637f81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5665 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.314339:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787782885.314344:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787782885.314349:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df1ba030/0x6d98ed19b637fa4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.314416:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b637f81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5665 expref: 8 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.314434:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b637f81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5665 expref: 8 pid: 6697 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782885.314451:0:6698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fd680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874625922419200:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787782885.314562:0:6698:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311f9be240 going to sleep for 11 seconds 00000100:00100000:0.0:1787782885.319244:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782885.319428:0:6698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fd680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1874625922419200:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787782885.319467:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000df1ba030/0x6d98ed19b637fa4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782885.319547:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904607616 00000100:00100000:1.0:1787782885.319556:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904607616 00010000:00010000:1.0:1787782885.319606:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b637f81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5665 expref: 9 pid: 6697 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782885.319870:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:1.0:1787782885.319883:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+9:2349:x1874625904607616:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782885.319905:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782885.319938:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b637f81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5665 expref: 9 pid: 6697 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.320144:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b637f81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5665 expref: 9 pid: 6697 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.320176:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b637f81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5665 expref: 9 pid: 6697 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.320197:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787782885.320203:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787782885.320210:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df1ba030/0x6d98ed19b637fa4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.320236:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df1ba030/0x6d98ed19b637fa4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.320319:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782885.320406:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2349:x1874625904607616:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 526us (1178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782885.320415:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 86 00010000:00010000:2.0:1787782885.322489:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000df1ba030/0x6d98ed19b637fa4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.322513:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df1ba030/0x6d98ed19b637fa4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.322623:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000df1ba030/0x6d98ed19b637fa4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.322633:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df1ba030/0x6d98ed19b637fa4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.322764:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df1ba030/0x6d98ed19b637fa4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.322840:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205400 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782885.322847:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df1ba030/0x6d98ed19b637fa4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.322858:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df1ba030/0x6d98ed19b637fa4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.322883:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df1ba030/0x6d98ed19b637fa4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.322891:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df1ba030/0x6d98ed19b637fa4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782885.323300:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2351:x1874625904607488:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 Request processed in 9393us (9839us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782885.323314:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:0.0:1787782885.326482:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782885.326589:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904607872 00000100:00100000:3.0:1787782885.326605:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904607872 00000100:00100000:3.0:1787782885.326930:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 230 00000100:00100000:3.0:1787782885.326943:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+19:11615:x1874625904607872:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787782885.327053:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637fab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.327077:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.327092:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.327938:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637fb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.327976:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f65 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5650 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.327986:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637fb2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.328035:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5650 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.328052:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5650 expref: 20 pid: 5851 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782885.328071:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346f03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922419328:192.168.202.15@tcp:104: 00000100:00100000:0.0:1787782885.328361:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31061e0600 going to sleep for 11 seconds 00000100:00100000:2.0:1787782885.332412:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782885.333225:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346f03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922419328:192.168.202.15@tcp:104: 00010000:00010000:0.0:1787782885.333266:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637fb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782885.333404:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904608000 00000100:00100000:1.0:1787782885.333414:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904608000 00010000:00010000:1.0:1787782885.333470:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5650 expref: 21 pid: 5851 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782885.333522:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:1.0:1787782885.333533:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+21:2350:x1874625904608000:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787782885.333558:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782885.333566:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f65 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5650 expref: 21 pid: 5851 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.333581:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5650 expref: 21 pid: 5851 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.333613:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637f65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5650 expref: 21 pid: 5851 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.333633:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3108738000) 00010000:00010000:1.0:1787782885.333898:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637fb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.333910:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.333920:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637fb2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.334093:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787782885.334194:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102e12c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+20:2350:x1874625904608000:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 661us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782885.334203:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 87 00010000:00010000:0.0:1787782885.335585:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.335605:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787782885.336048:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1787782885.336440:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787782885.336495:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1787782885.336610:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346f03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5852:1874625922419456:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787782885.336937:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782885.337041:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31061e0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787782885.337255:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922419456 00000100:00100000:2.0:1787782885.337265:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922419456 00000100:00100000:0.0:1787782885.337434:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787782885.337446:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1874625922419456:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787782885.337551:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1874625922419456:12345-0@lo:1000:mdt00_001.0 Request processed in 106us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782885.337560:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787782885.337633:0:5852:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1787782885.337651:0:5852:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:2.0:1787782885.337683:0:5852:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8c313c97f480 x1874625922418816/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787782901 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782885.337697:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346f03c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5852:1874625922419456:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787782885.338410:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787782885.338504:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fd680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5852:1874625922419584:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787782885.338561:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782885.339115:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787782885.339296:0:12025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922419584 00000100:00100000:1.0:1787782885.339305:0:12025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922419584 00000100:00100000:1.0:1787782885.339352:0:12025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787782885.339363:0:12025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5852:x1874625922419584:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787782885.339625:0:12025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346ffc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5852:x1874625922419584:12345-0@lo:1000:mdt00_001.0 Request processed in 263us (1063us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787782885.339633:0:12025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787782885.339927:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fd680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5852:1874625922419584:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787782885.339981:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.339993:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637fb2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.340001:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637fb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.340026:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782885.340032:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637fb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.340041:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637fb2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.340063:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3108738000) 00010000:00010000:2.0:1787782885.340068:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787782885.340073:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637fb2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.340080:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b637fb2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.340153:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ef5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.340161:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ef5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.340169:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ef5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.340173:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787782885.340177:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ef5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.340182:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ef5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.340202:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:2.0:1787782885.340204:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787782885.340213:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637efc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5634 expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.340225:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637efc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5634 expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.340235:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637efc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5634 expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782885.340275:0:5852:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637efc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5634 expref: 23 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782885.340292:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346ff840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922419712:192.168.202.15@tcp:105: 00000100:00100000:2.0:1787782885.340393:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787782885.344049:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782885.344315:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346ff840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5852:1874625922419712:192.168.202.15@tcp:105: 00010000:00010000:0.0:1787782885.344358:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ef5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344373:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204400/0x6d98ed19b637ef5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344425:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637fb9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344443:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344457:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344469:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344475:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637fb9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344483:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637fb9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344507:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782885.344512:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637fb9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344520:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637fb9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344534:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:0.0:1787782885.344537:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787782885.344542:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637fb9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344548:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254200/0x6d98ed19b637fb9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344559:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344566:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637fab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344572:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637fab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344578:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787782885.344581:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637fab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344586:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637fab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344606:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:0.0:1787782885.344608:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787782885.344612:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637fab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782885.344618:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1600/0x6d98ed19b637fab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782885.345172:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+23:11615:x1874625904607872:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 18226us (18699us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1787782885.345186:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 230 00000020:00080000:0.0:1787782885.345194:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787782885.345736:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787782885.345744:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787782885.346376:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787782885.346389:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787782885.349250:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782885.349890:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904608128 00000100:00100000:1.0:1787782885.349905:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904608128 00000100:00100000:1.0:1787782885.349979:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904608384 00000100:00100000:1.0:1787782885.349983:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904608384 00000100:00100000:1.0:1787782885.350002:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:1.0:1787782885.350013:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+24:11614:x1874625904608128:12345-192.168.202.15@tcp:49:lfs.0 00000100:00100000:3.0:1787782885.350264:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 62 00000100:00100000:3.0:1787782885.350293:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310619ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+24:11615:x1874625904608384:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787782885.351354:0:11490:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787782885.351480:0:11490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1787782885.351546:0:11490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637fc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.351568:0:11490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.351583:0:11490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.351592:0:11490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637fc0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.351599:0:11490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637fc0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.351606:0:11490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637fc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.351635:0:11490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787782885.352327:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+26:11614:x1874625904608128:12345-192.168.202.15@tcp:49:lfs.0 Request processed in 2306us (8285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782885.352340:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 61 00000100:00100000:3.0:1787782885.352457:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310619ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+25:11615:x1874625904608384:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 2166us (3223us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1787782885.352467:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 62 00000020:00080000:3.0:1787782885.352471:0:11490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787782885.352527:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782885.352535:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637fc0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.352545:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787782885.352557:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637fc0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.352567:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637fc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.352584:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c3104d6ea00) 00010000:00010000:3.0:1787782885.352588:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787782885.352595:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637fc0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.352602:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b637fc0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.352625:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782885.352626:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782885.352628:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782885.357333:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782885.357451:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904608640 00000100:00100000:2.0:1787782885.357462:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904608640 00000100:00100000:2.0:1787782885.357910:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 231 00000100:00100000:2.0:1787782885.357924:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+25:11614:x1874625904608640:12345-192.168.202.15@tcp:58:lfs.0 00000040:00080000:2.0:1787782885.358320:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787782885.358461:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+25:11614:x1874625904608640:12345-192.168.202.15@tcp:58:lfs.0 Request processed in 539us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782885.358472:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 231 00000100:00100000:2.0:1787782885.392026:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782885.392261:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904608768 00000100:00100000:1.0:1787782885.392275:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904608768 00000100:00100000:1.0:1787782885.392358:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 232 00000100:00100000:1.0:1787782885.392371:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+25:11617:x1874625904608768:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787782885.392401:0:6719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782885.392430:0:6719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637fc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e566c expref: -99 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.392518:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637fce lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.392535:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637fce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.392548:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637fce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.392565:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637fd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.392573:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.392580:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.393287:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637fdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.393304:0:6719:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e562d expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.393327:0:6719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637fdc lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.393371:0:6719:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e562d expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.393388:0:6719:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e562d expref: 26 pid: 5852 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782885.393406:0:6719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6719:1874625922419840:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787782885.393514:0:6719:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782885.396701:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782885.396830:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904609024 00000100:00100000:2.0:1787782885.396844:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904609024 00000100:00100000:2.0:1787782885.396925:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:2.0:1787782885.396938:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+27:5587:x1874625904609024:12345-192.168.202.15@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787782885.397303:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+28:5587:x1874625904609024:12345-192.168.202.15@tcp:35:ldlm_bl.0 Request processed in 366us (618us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787782885.397311:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 63 00000100:00100000:1.0:1787782885.399621:0:6719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6719:1874625922419840:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787782885.399661:0:6719:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637fdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782885.401204:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782885.401428:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904609152 00000100:00100000:3.0:1787782885.401441:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904609152 00010000:00010000:3.0:1787782885.401498:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e562d expref: 28 pid: 5852 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782885.401619:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:3.0:1787782885.402004:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+28:2350:x1874625904609152:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782885.402028:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782885.402040:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e562d expref: 28 pid: 5852 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.402060:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e562d expref: 28 pid: 5852 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.402142:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205c00/0x6d98ed19b637ee7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e562d expref: 28 pid: 5852 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.402163:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:3.0:1787782885.402169:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637fdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.402178:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.402186:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637fdc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782885.402219:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782885.402294:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+27:2350:x1874625904609152:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 656us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782885.402302:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 88 00010000:00010000:1.0:1787782885.402399:0:6719:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402410:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782885.402473:0:6719:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787782885.402478:0:6719:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787782885.402504:0:6719:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402520:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402554:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637fce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402562:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637fce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402571:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637fce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402577:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782885.402583:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637fce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402591:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637fce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402606:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782885.402610:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782885.402615:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637fce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402621:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6200/0x6d98ed19b637fce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402647:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402654:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637fd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402659:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402670:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782885.402673:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402679:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637fd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402688:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c312eeef400) 00010000:00010000:1.0:1787782885.402691:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782885.402694:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637fd5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402701:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6c00/0x6d98ed19b637fd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.402763:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7600/0x6d98ed19b637fc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e566c expref: 27 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.404660:0:6719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637fdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e566c expref: 26 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782885.404678:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:1.0:1787782885.404681:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782885.404685:0:6719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6400, rc 0) 00000100:00100000:1.0:1787782885.404796:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+26:11617:x1874625904608768:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 12425us (12784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782885.404806:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 232 00010000:00010000:3.0:1787782885.737935:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782885.898519:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782885.898585:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782885.898625:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782885.898655:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904609280 00000100:00100000:2.0:1787782885.898669:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904609280 00000100:00100000:1.0:1787782885.898719:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904609536 00000100:00100000:1.0:1787782885.898743:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904609536 00000100:00100000:2.0:1787782885.898801:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 305 00000100:00100000:1.0:1787782885.898810:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 173 00000100:00100000:2.0:1787782885.898813:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109137050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2352:x1874625904609280:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782885.898817:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2352:x1874625904609536:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782885.898912:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904609408 00000100:00100000:2.0:1787782885.898913:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109137050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2352:x1874625904609280:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 103us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782885.898916:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904609408 00000100:00100000:2.0:1787782885.898922:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 305 00000100:00100000:3.0:1787782885.898968:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 103 00000100:00100000:3.0:1787782885.898978:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2352:x1874625904609408:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787782885.902191:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2352:x1874625904609536:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 3353us (3544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782885.902212:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 173 00000100:00080000:2.0:1787782885.903356:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787782885.903371:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782885.908365:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2352:x1874625904609408:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 9364us (9837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782885.908387:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 103 00000040:00080000:2.0:1787782886.370475:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787782886.370488:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787782886.370538:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787782886.370545:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787782886.370724:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fcf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874625922419968:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787782886.370922:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787782886.379479:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fcf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11692:1874625922419968:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787782886.385818:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782886.386283:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904609664 00000100:00100000:2.0:1787782886.386297:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904609664 00000100:00100000:2.0:1787782886.386392:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 233 00000100:00100000:2.0:1787782886.386404:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+26:11628:x1874625904609664:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787782886.386455:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787782886.386610:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+26:11628:x1874625904609664:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 208us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782886.386619:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 233 00000100:00080000:0.0:1787782886.386632:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782886.389950:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782886.390046:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904609920 00000100:00100000:1.0:1787782886.390059:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904609920 00000100:00100000:1.0:1787782886.390167:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 234 00000100:00100000:1.0:1787782886.390178:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+26:11628:x1874625904609920:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787782886.390206:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782886.390233:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637fe3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5673 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782886.390359:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637fea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782886.390376:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782886.390393:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787782886.390406:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787782886.390559:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637fe3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5673 expref: 29 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782886.390589:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637fea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5673 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782886.390598:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:1.0:1787782886.390601:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782886.390605:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7200, rc 0) 00000100:00100000:1.0:1787782886.390684:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+28:11628:x1874625904609920:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 507us (750us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787782886.390692:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 234 00000100:00100000:0.0:1787782886.402127:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782886.402181:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782886.402231:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904610304 00000100:00100000:3.0:1787782886.402245:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904610304 00000100:00100000:3.0:1787782886.402344:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:3.0:1787782886.402356:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+28:2351:x1874625904610304:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782886.402377:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787782886.402434:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904610176 00000100:00100000:1.0:1787782886.402441:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904610176 00000100:00100000:1.0:1787782886.402483:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 235 00000100:00100000:1.0:1787782886.402492:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+29:11628:x1874625904610176:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787782886.402587:0:6719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637ff8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782886.402611:0:6719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782886.402626:0:6719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782886.402888:0:6719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637ff8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782886.402897:0:6719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637ff8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782886.402913:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637ff8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782886.402919:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787782886.402924:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637ff8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782886.402932:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637ff8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782886.402948:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:1.0:1787782886.402951:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787782886.402957:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637ff8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782886.402963:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7000/0x6d98ed19b637ff8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782886.403225:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7200/0x6d98ed19b637fea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5673 expref: 30 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782886.403237:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:3.0:1787782886.403241:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:0.0:1787782886.403249:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787782886.403254:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787782886.403298:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+29:2351:x1874625904610304:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 945us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782886.403308:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:1.0:1787782886.403595:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+28:11628:x1874625904610176:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 1104us (1504us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787782886.403603:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 235 00000040:00080000:0.0:1787782886.403741:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787782886.403750:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787782886.406379:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782886.406453:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904610560 00000100:00100000:3.0:1787782886.406465:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904610560 00000100:00100000:3.0:1787782886.406543:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 64 00000100:00100000:3.0:1787782886.406556:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+28:11628:x1874625904610560:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787782886.407649:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+29:11628:x1874625904610560:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 1089us (1277us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1787782886.407663:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 64 00000040:00080000:1.0:1787782886.426404:0:12523:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787782886.426419:0:12523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787782886.426476:0:12523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787782886.426482:0:12523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787782886.686315:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782886.686537:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904610816 00000100:00100000:3.0:1787782886.686550:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904610816 00000100:00100000:3.0:1787782886.686773:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 236 00000100:00100000:3.0:1787782886.686787:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+29:11641:x1874625904610816:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:3.0:1787782886.686819:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782886.686847:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637fff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e567a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782886.686990:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b638006 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782886.687010:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b638006 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782886.687024:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b638006 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787782886.687036:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787782886.687571:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0000/0x6d98ed19b637fff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e567a expref: 32 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782886.687590:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b638006 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e567a expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782886.687600:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:3.0:1787782886.687604:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787782886.687608:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1c00, rc 0) 00000100:00100000:3.0:1787782886.687686:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+31:11641:x1874625904610816:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 903us (1390us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787782886.687694:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 236 00000100:00100000:3.0:1787782886.701691:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782886.701754:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904610944 00000100:00100000:3.0:1787782886.701779:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904610944 00000100:00100000:3.0:1787782886.701868:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 237 00000100:00100000:3.0:1787782886.701882:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312eff9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+31:11641:x1874625904610944:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:3.0:1787782886.702019:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b638014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782886.702047:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b638014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782886.703756:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b638014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782886.703829:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b638014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782886.703838:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b638014 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782886.703847:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b638014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782886.703854:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787782886.703860:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b638014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782886.703870:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b638014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782886.703887:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:3.0:1787782886.703891:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787782886.703897:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b638014 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782886.703904:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1e00/0x6d98ed19b638014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782886.704594:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312eff9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+31:11641:x1874625904610944:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 2705us (2909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782886.704609:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 237 00010000:00010000:1.0:1787782886.757799:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782886.833472:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782886.833688:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904611072 00000100:00100000:0.0:1787782886.833712:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904611072 00000100:00100000:0.0:1787782886.833820:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00100000:0.0:1787782886.833835:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2349:x1874625904611072:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:0.0:1787782886.833867:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782886.833912:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2d249e5/0x6d98ed19b63801b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5681 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787782886.834158:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8f66e4, atime: 0x6a8f66e3, ctime: 0x6a8f66e4, blocks: 0xb 00010000:00010000:0.0:1787782886.834190:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1787782886.834196:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787782886.834213:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2d249e5/0x6d98ed19b63801b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5681 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782886.834236:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2d249e5/0x6d98ed19b63801b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5681 expref: 8 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782886.834254:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254400, rc 0) 00000100:00100000:0.0:1787782886.834337:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2349:x1874625904611072:12345-192.168.202.15@tcp:101:cat.0 Request processed in 505us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782886.834345:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 70 00000100:00100000:3.0:1787782886.839340:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782886.852736:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904611200 00000100:00100000:2.0:1787782886.852794:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904611200 00002000:00100000:3.0:1787782886.853149:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8c312f2c8780 x1874625904611200/t0(0) o3->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:277/0 lens 488/0 e 0 to 0 dl 1787782897 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787782886.853163:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c312f2c8780 with x1874625904611200 ext(0->4095) 00002000:00010000:3.0:1787782886.853171:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c312f2c8780 00000100:00100000:3.0:1787782886.853220:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:3.0:1787782886.853231:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2350:x1874625904611200:12345-192.168.202.15@tcp:3:cat.0 00000100:00100000:3.0:1787782886.853645:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+8:2350:x1874625904611200:12345-192.168.202.15@tcp:3:cat.0 Request processed in 414us (14319us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787782886.853655:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00002000:00100000:3.0:1787782886.853662:0:6703:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8c312f2c8780 x1874625904611200/t0(0) o3->6e4b0e72-6952-496d-b228-ab2778cd786f@192.168.202.15@tcp:277/0 lens 488/4536 e 0 to 0 dl 1787782897 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787782886.853670:0:6703:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c312f2c8780 with x1874625904611200 ext(0->4095) 00002000:00010000:3.0:1787782886.853673:0:6703:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c312f2c8780 00010000:00010000:3.0:1787782887.777255:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787782888.187223:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1787782888.187247:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1787782888.187254:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:3.0:1787782888.801420:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782889.061017:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874625922420352:0@lo:400:kworker.0 00000100:00100000:3.0:1787782889.061142:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782889.061241:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787782889.061248:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310825a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922420224:0@lo:400:kworker.0 00000100:00100000:3.0:1787782889.061286:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782889.061307:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922420736:0@lo:400:kworker.0 00000100:00100000:3.0:1787782889.061336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782889.061381:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922420352 00000100:00100000:3.0:1787782889.061390:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922420352 00000100:00100000:3.0:1787782889.061456:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922420224 00000100:00100000:3.0:1787782889.061460:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922420224 00000100:00100000:3.0:1787782889.061485:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787782889.061496:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874625922420352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782889.061562:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874625922420352:12345-0@lo:400:kworker.0 Request processed in 66us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782889.061570:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787782889.061594:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787782889.061600:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922420224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782889.061629:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922420224:12345-0@lo:400:kworker.0 Request processed in 29us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782889.061635:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787782889.061656:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922420736 00000100:00100000:3.0:1787782889.061660:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922420736 00000100:00100000:3.0:1787782889.061687:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787782889.061695:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922420736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782889.061728:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922420736:12345-0@lo:400:kworker.0 Request processed in 35us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782889.061734:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1787782889.061768:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787782889.061775:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782889.061833:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310825a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922420224:0@lo:400:kworker.0 00000100:00100000:3.0:1787782889.061855:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787782889.061862:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1787782889.061894:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c312effa1c0, transno 4294967310 00000100:00100000:3.0:1787782889.061908:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc88b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922420736:0@lo:400:kworker.0 00000100:00100000:3.0:1787782889.061920:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874625922420352:0@lo:400:kworker.0 00000100:00100000:2.0:1787782889.062469:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922420480:0@lo:400:kworker.0 00000100:00100000:2.0:1787782889.062516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782889.062567:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787782889.062575:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c310825a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922420096:0@lo:400:kworker.0 00000100:00100000:2.0:1787782889.062608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782889.062641:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922420608:0@lo:400:kworker.0 00000100:00100000:2.0:1787782889.062665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782889.062699:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922420608 00000100:00100000:2.0:1787782889.062704:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922420608 00000100:00100000:2.0:1787782889.062762:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787782889.062771:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922420608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782889.062816:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922420608:12345-0@lo:400:kworker.0 Request processed in 47us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782889.062823:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:2.0:1787782889.062845:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782889.062866:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922420608:0@lo:400:kworker.0 00000100:00100000:1.0:1787782889.062958:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922420096 00000100:00100000:1.0:1787782889.062963:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922420096 00000100:00100000:1.0:1787782889.062999:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787782889.063006:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109136450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3304:x1874625922420096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782889.063052:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109136450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3304:x1874625922420096:12345-0@lo:400:kworker.0 Request processed in 47us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782889.063058:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1787782889.063125:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c310825a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922420096:0@lo:400:kworker.0 00000100:00100000:3.0:1787782889.063771:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922420480 00000100:00100000:3.0:1787782889.063780:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922420480 00000100:00100000:3.0:1787782889.063977:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787782889.063988:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1874625922420480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782889.064060:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1874625922420480:12345-0@lo:400:kworker.0 Request processed in 75us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782889.064067:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787782889.064151:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922420480:0@lo:400:kworker.0 00000100:00080000:1.0:1787782889.073026:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787782889.569459:0:6959:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374239358724ns, next at 375239355369ns, rc = 0 00000100:00100000:3.0:1787782889.569551:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922420864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782889.569652:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782889.570329:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787782889.570345:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922420992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782889.570390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782889.582387:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922420864 00000100:00100000:2.0:1787782889.582409:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922420864 00000100:00100000:3.0:1787782889.582779:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922420992 00000100:00100000:3.0:1787782889.582785:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922420992 00000100:00100000:3.0:1787782889.582820:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787782889.582831:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874625922420864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782889.582885:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782889.583769:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874625922420864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 936us (14112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782889.583780:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787782889.583812:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787782889.583823:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31340bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922420992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787782889.583869:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782889.583913:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31340bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922420992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (13522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782889.583920:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787782889.584258:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922420864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787782889.588555:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922420992:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787782889.856261:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787782890.678745:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:0.0:1787782890.678764:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1787782890.683065:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967511 is committed 00000004:00080000:3.0:1787782890.683242:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000001:00080000:3.0:1787782890.683265:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000100:00100000:1.0:1787782890.683349:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782890.683369:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922421120:0@lo:2:osp-syn-0-0.0 00000020:00080000:3.0:1787782890.683393:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c311f9becc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787782890.683397:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c3112375d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c311f9be240 00000020:00080000:3.0:1787782890.683400:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c3112375300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c313403c800 00000020:00080000:2.0:1787782890.683429:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000100:00100000:1.0:1787782890.683440:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782890.683499:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922421120 00000100:00100000:1.0:1787782890.683506:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922421120 00000100:00100000:1.0:1787782890.683550:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787782890.683557:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31342fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922421120:12345-0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1787782890.683608:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00002000:00010000:1.0:1787782890.683748:0:6697:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787782890.683752:0:6697:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787782884 -> 1787782884 00002000:00010000:1.0:1787782890.683755:0:6697:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1787782883 -> 1787782883 00002000:00010000:1.0:1787782890.683757:0:6697:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787782884 -> 1787782884 00002000:00010000:1.0:1787782890.683760:0:6697:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787782890.683808:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31342fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625922421120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 249us (365us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787782890.683830:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787782890.683908:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:2.0:1787782890.683914:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c313c97f480, transno 4294967321 00000004:00080000:2.0:1787782890.683927:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:2.0:1787782890.683947:0:3304:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8c313c94c3c0 x1874625922421120/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787782906 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787782890.683960:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c313c94c3c0/2, rc 0, transno 4294967324 00000100:00100000:2.0:1787782890.683965:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922421120:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1787782890.684064:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1787782890.684075:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1787782890.850006:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782891.029323:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782891.029375:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782891.029413:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782891.029433:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782891.029456:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782891.029485:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904611584 00000100:00100000:1.0:1787782891.029495:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904611584 00000100:00100000:3.0:1787782891.029497:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904611840 00000100:00100000:3.0:1787782891.029500:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904611840 00000100:00100000:1.0:1787782891.029553:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904611712 00000100:00100000:1.0:1787782891.029557:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904611712 00000100:00100000:0.0:1787782891.029566:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904611328 00000100:00100000:0.0:1787782891.029569:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904611328 00000100:00100000:2.0:1787782891.029581:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904611456 00000100:00100000:2.0:1787782891.029587:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904611456 00000100:00100000:0.0:1787782891.029608:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 307 00000100:00100000:0.0:1787782891.029618:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3109135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2351:x1874625904611328:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782891.029715:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3109135c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2351:x1874625904611328:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 98us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782891.029734:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 307 00000100:00100000:0.0:1787782891.029769:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 106 00000100:00100000:0.0:1787782891.029776:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2351:x1874625904611584:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782891.029805:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2351:x1874625904611584:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 30us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782891.029812:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 106 00000100:00100000:3.0:1787782891.035904:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 177 00000100:00100000:3.0:1787782891.035919:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2351:x1874625904611840:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782891.035991:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2351:x1874625904611840:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 77us (6578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782891.035999:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 177 00000100:00100000:3.0:1787782891.038467:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 107 00000100:00100000:3.0:1787782891.038486:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2351:x1874625904611712:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782891.038563:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2351:x1874625904611712:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 85us (9106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782891.038571:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 107 00000100:00100000:2.0:1787782891.043580:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 178 00000100:00100000:2.0:1787782891.043596:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+18:2351:x1874625904611456:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782891.043701:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+18:2351:x1874625904611456:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 108us (14264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782891.043710:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 178 00000100:00080000:0.0:1787782891.059716:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787782891.059738:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787782891.059741:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787782891.876270:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782892.681059:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782892.681822:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904611968 00000100:00100000:1.0:1787782892.681838:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904611968 00000100:00100000:1.0:1787782892.681941:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 238 00000100:00100000:1.0:1787782892.681967:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+18:11302:x1874625904611968:12345-192.168.202.15@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787782892.692500:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e4b0e72-6952-496d-b228-ab2778cd786f+18:11302:x1874625904611968:12345-192.168.202.15@tcp:60:lhsmtool_posix.0 Request processed in 10516us (11439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782892.692521:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 238 00000100:00100000:3.0:1787782892.696652:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782892.696742:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904612224 00000100:00100000:0.0:1787782892.696754:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904612224 00000100:00100000:0.0:1787782892.696841:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 65 00000100:00100000:0.0:1787782892.696852:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+18:11302:x1874625904612224:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787782892.702630:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e4b0e72-6952-496d-b228-ab2778cd786f+19:11302:x1874625904612224:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 5760us (5986us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787782892.702649:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 65 00010000:00010000:3.0:1787782892.897757:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782892.932956:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782892.933091:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904612352 00000100:00100000:2.0:1787782892.933130:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904612352 00000100:00100000:2.0:1787782892.933284:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 239 00000100:00100000:2.0:1787782892.933295:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:12093:x1874625904612352:12345-192.168.202.15@tcp:101:lsof.0 00010000:00010000:2.0:1787782892.933323:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782892.933349:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b638022 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5688 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782892.933430:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b638029 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782892.933446:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b638029 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782892.933459:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b638029 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787782892.933940:0:5851:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787782892.933946:0:5851:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787782892.934036:0:5851:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b638029 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782892.934071:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204000/0x6d98ed19b638022 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5688 expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782892.934093:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b638029 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5688 expref: 6 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782892.934423:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312eeef200) 00010000:00010000:2.0:1787782892.934427:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787782892.934431:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141205a00, rc 0) 00000100:00100000:2.0:1787782892.934526:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:12093:x1874625904612352:12345-192.168.202.15@tcp:101:lsof.0 Request processed in 1230us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782892.934543:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 239 00010000:00010000:3.0:1787782893.921988:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782894.177482:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922421504:0@lo:400:kworker.0 00000100:00100000:0.0:1787782894.177608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782894.178017:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922421248:0@lo:400:kworker.0 00000100:00100000:1.0:1787782894.178065:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782894.178132:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782894.178139:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922421376:0@lo:400:kworker.0 00000100:00100000:1.0:1787782894.178167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782894.178209:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922421248 00000100:00100000:1.0:1787782894.178218:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922421248 00000100:00100000:1.0:1787782894.178278:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787782894.178288:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3107e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922421248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782894.178350:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3107e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922421248:12345-0@lo:400:kworker.0 Request processed in 63us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782894.178358:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787782894.178417:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922421248:0@lo:400:kworker.0 00000100:00100000:1.0:1787782894.178442:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922421504 00000100:00100000:1.0:1787782894.178446:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922421504 00000100:00100000:1.0:1787782894.178488:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922421376 00000100:00100000:1.0:1787782894.178491:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922421376 00000100:00100000:1.0:1787782894.178532:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787782894.178538:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922421504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782894.178761:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787782894.178773:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922421376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782894.178820:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922421376:12345-0@lo:400:kworker.0 Request processed in 51us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782894.178827:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787782894.178877:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922421376:0@lo:400:kworker.0 00000100:00100000:3.0:1787782894.178914:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922421632:0@lo:400:kworker.0 00000100:00100000:3.0:1787782894.178949:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787782894.178991:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782894.179016:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922421632 00000100:00100000:3.0:1787782894.179020:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922421632 00000100:00100000:3.0:1787782894.179055:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787782894.179062:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625922421632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782894.179114:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874625922421632:12345-0@lo:400:kworker.0 Request processed in 52us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782894.179133:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1787782894.179152:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787782894.179171:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922421632:0@lo:400:kworker.0 00000100:00100000:1.0:1787782894.181603:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922421504:12345-0@lo:400:kworker.0 Request processed in 3049us (3980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782894.181621:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787782894.182674:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922421888:0@lo:400:kworker.0 00000100:00100000:2.0:1787782894.182975:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782894.183023:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787782894.183030:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922421760:0@lo:400:kworker.0 00000100:00100000:2.0:1787782894.183062:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782894.183120:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922421888 00000100:00100000:2.0:1787782894.183128:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922421888 00000100:00100000:2.0:1787782894.183199:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787782894.183210:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922421888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782894.183274:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922421888:12345-0@lo:400:kworker.0 Request processed in 66us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782894.183282:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1787782894.183305:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787782894.183341:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922421888:0@lo:400:kworker.0 00000100:00100000:2.0:1787782894.183367:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922421760 00000100:00100000:2.0:1787782894.183371:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922421760 00000100:00100000:2.0:1787782894.183405:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787782894.183412:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922421760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782894.183449:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874625922421760:12345-0@lo:400:kworker.0 Request processed in 38us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782894.183455:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:2.0:1787782894.183469:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782894.183485:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874625922421760:0@lo:400:kworker.0 00000100:00100000:0.0:1787782894.185277:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922421504:0@lo:400:kworker.0 00000040:00080000:0.0:1787782894.625602:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787782894.625616:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787782894.626007:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1787782894.626024:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787782894.689741:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922422016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787782894.689877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782894.692417:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787782894.692445:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922422144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787782894.692536:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782894.693069:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922422016 00000100:00100000:3.0:1787782894.693081:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922422016 00000100:00100000:3.0:1787782894.693173:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922422144 00000100:00100000:3.0:1787782894.693177:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922422144 00000100:00100000:3.0:1787782894.693197:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787782894.693208:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625922422016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782894.693259:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782894.693342:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874625922422016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (3466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782894.693351:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787782894.693371:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787782894.693377:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922422144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787782894.693400:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782894.693431:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922422144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782894.693437:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787782894.693563:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922422144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787782894.693587:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922422016:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787782894.945516:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787782895.853364:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1787782895.853384:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1787782895.853548:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1787782895.853565:0:5885:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:0.0:1787782895.864881:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:3.0:1787782895.969305:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782896.143553:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782896.143617:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782896.143659:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782896.143852:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904612608 00000100:00100000:3.0:1787782896.143862:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904612608 00000100:00100000:3.0:1787782896.143926:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 182 00000100:00100000:3.0:1787782896.143938:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+18:2350:x1874625904612608:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782896.144033:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+18:2350:x1874625904612608:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 98us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782896.144042:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 182 00000100:00100000:1.0:1787782896.144758:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782896.144785:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782896.144919:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904612480 00000100:00100000:2.0:1787782896.144926:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904612480 00000100:00100000:2.0:1787782896.144969:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 309 00000100:00100000:2.0:1787782896.144978:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3107e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2350:x1874625904612480:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782896.145025:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3107e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2350:x1874625904612480:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 48us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782896.145032:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 309 00000100:00080000:2.0:1787782896.145072:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782896.145086:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904612992 00000100:00100000:2.0:1787782896.145089:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904612992 00000100:00100000:2.0:1787782896.145150:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 183 00000100:00100000:2.0:1787782896.145157:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:2350:x1874625904612992:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782896.145186:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:2350:x1874625904612992:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 30us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782896.145347:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 183 00000100:00080000:2.0:1787782896.145455:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782896.145787:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904612864 00000100:00100000:0.0:1787782896.145792:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904612864 00000100:00100000:0.0:1787782896.145834:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904612736 00000100:00100000:0.0:1787782896.145837:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904612736 00000100:00100000:0.0:1787782896.145858:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 110 00000100:00100000:0.0:1787782896.145865:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31347f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2350:x1874625904612864:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782896.145903:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31347f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2350:x1874625904612864:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 39us (2295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782896.145908:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 110 00000100:00100000:0.0:1787782896.145920:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 111 00000100:00100000:0.0:1787782896.145925:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31344ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2350:x1874625904612736:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787782896.145947:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31344ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2350:x1874625904612736:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 22us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782896.145953:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 111 00000100:00080000:2.0:1787782896.146933:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787782896.146953:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787782896.994215:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787782897.118454:0:12728:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 18:21:35 (1787782895) 00010000:00010000:3.0:1787782898.017213:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782899.042686:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782899.297507:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922422272:0@lo:400:kworker.0 00000100:00100000:3.0:1787782899.297612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782899.297682:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922422784:0@lo:400:kworker.0 00000100:00100000:3.0:1787782899.297715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782899.297746:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787782899.297753:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922422400:0@lo:400:kworker.0 00000100:00100000:3.0:1787782899.297779:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782899.297795:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312effa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922422912:0@lo:400:kworker.0 00000100:00100000:3.0:1787782899.297821:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782899.297853:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922422656:0@lo:400:kworker.0 00000100:00100000:3.0:1787782899.297902:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782899.297923:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787782899.297930:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625922422528:0@lo:400:kworker.0 00000100:00100000:3.0:1787782899.297953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782899.297987:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922422272 00000100:00100000:3.0:1787782899.297998:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922422272 00000100:00100000:3.0:1787782899.298056:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787782899.298065:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922422272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782899.298152:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922422272:12345-0@lo:400:kworker.0 Request processed in 87us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782899.298169:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787782899.298213:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922422784 00000100:00100000:3.0:1787782899.298217:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922422784 00000100:00100000:3.0:1787782899.298251:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922422400 00000100:00100000:3.0:1787782899.298254:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922422400 00000100:00100000:3.0:1787782899.298266:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922422528 00000100:00100000:3.0:1787782899.298268:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922422528 00000100:00100000:3.0:1787782899.298283:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787782899.298288:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922422784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782899.298325:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922422784:12345-0@lo:400:kworker.0 Request processed in 36us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782899.298331:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787782899.298343:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787782899.298349:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310825a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922422400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782899.298375:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310825a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922422400:12345-0@lo:400:kworker.0 Request processed in 27us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782899.298382:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787782899.298391:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787782899.298396:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625922422528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782899.298425:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccaad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625922422528:12345-0@lo:400:kworker.0 Request processed in 29us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782899.298431:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787782899.298478:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625922422528:0@lo:400:kworker.0 00000100:00100000:3.0:1787782899.298509:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc88f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922422400:0@lo:400:kworker.0 00000100:00100000:3.0:1787782899.298518:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc89a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922422272:0@lo:400:kworker.0 00000100:00100000:3.0:1787782899.298536:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922422784:0@lo:400:kworker.0 00000100:00080000:2.0:1787782899.301725:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787782899.302455:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922422912 00000100:00100000:1.0:1787782899.302470:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922422912 00000100:00100000:1.0:1787782899.302546:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922422656 00000100:00100000:1.0:1787782899.302550:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922422656 00000100:00100000:1.0:1787782899.302577:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787782899.302587:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922422912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782899.302719:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119ef4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922422912:12345-0@lo:400:kworker.0 Request processed in 134us (4895us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782899.302727:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787782899.302745:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787782899.302751:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccaa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922422656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782899.302782:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccaa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922422656:12345-0@lo:400:kworker.0 Request processed in 31us (4880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782899.302788:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787782899.302846:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312effa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922422912:0@lo:400:kworker.0 00000100:00100000:1.0:1787782899.302886:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787782899.302891:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c313c94c3c0, transno 4294967324 00000100:00100000:1.0:1787782899.302917:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922422656:0@lo:400:kworker.0 00000100:00080000:2.0:1787782899.302968:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787782899.302973:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787782899.809444:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922423040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782899.809552:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782899.809661:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922423040 00000100:00100000:1.0:1787782899.809671:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922423040 00000100:00100000:1.0:1787782899.809730:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787782899.809739:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922423040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782899.809786:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782899.809835:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922423040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782899.809843:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787782899.809897:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922423040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787782899.813006:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cca83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922423168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782899.813128:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782899.813366:0:8475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922423168 00000100:00100000:1.0:1787782899.813376:0:8475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922423168 00000100:00100000:1.0:1787782899.813480:0:8475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787782899.813492:0:8475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922423168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787782899.813552:0:8475:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782899.813624:0:8475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922423168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782899.813633:0:8475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787782899.814744:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cca83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922423168:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787782900.065355:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782901.089353:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782901.258534:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782901.258602:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782901.258878:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782901.258908:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782901.258973:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782901.259056:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904613632 00000100:00100000:3.0:1787782901.259070:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904613632 00000100:00100000:3.0:1787782901.259182:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904613248 00000100:00100000:3.0:1787782901.259186:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904613248 00000100:00100000:3.0:1787782901.259214:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 187 00000100:00100000:3.0:1787782901.259227:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:2350:x1874625904613632:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782901.259358:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:2350:x1874625904613632:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 133us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782901.259368:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 187 00000100:00100000:3.0:1787782901.259392:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 188 00000100:00100000:3.0:1787782901.259399:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+18:2350:x1874625904613248:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787782901.259428:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+18:2350:x1874625904613248:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 29us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782901.259434:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 188 00000100:00100000:2.0:1787782901.260018:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904613120 00000100:00100000:2.0:1787782901.260026:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904613120 00000100:00100000:2.0:1787782901.260080:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 311 00000100:00100000:2.0:1787782901.260088:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2350:x1874625904613120:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782901.260156:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2350:x1874625904613120:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 69us (1639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782901.260163:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 311 00000100:00080000:2.0:1787782901.260204:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782901.265807:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904613376 00000100:00100000:0.0:1787782901.265827:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904613376 00000100:00100000:0.0:1787782901.265960:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904613504 00000100:00100000:0.0:1787782901.265964:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904613504 00000100:00080000:1.0:1787782901.266016:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787782901.266022:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787782901.266064:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:2.0:1787782901.266079:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2350:x1874625904613376:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782901.266222:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2350:x1874625904613376:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 147us (7618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782901.266229:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 114 00000100:00100000:2.0:1787782901.266251:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:2.0:1787782901.266258:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2350:x1874625904613504:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787782901.266286:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2350:x1874625904613504:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 29us (7314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782901.266293:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 115 00000100:00100000:2.0:1787782901.536051:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782901.536227:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904613888 00000100:00100000:3.0:1787782901.536244:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904613888 00000100:00100000:3.0:1787782901.536328:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:3.0:1787782901.536342:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+18:12314:x1874625904613888:12345-192.168.202.15@tcp:35:umount.0 00000100:00100000:3.0:1787782901.537692:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+19:12314:x1874625904613888:12345-192.168.202.15@tcp:35:umount.0 Request processed in 1343us (1653us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787782901.537705:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 66 00000100:00100000:1.0:1787782901.543775:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782901.543963:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904614144 00000100:00100000:3.0:1787782901.543992:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904614144 00000100:00100000:3.0:1787782901.544061:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:3.0:1787782901.544072:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+19:12314:x1874625904614144:12345-192.168.202.15@tcp:35:umount.0 00000100:00100000:3.0:1787782901.544556:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+20:12314:x1874625904614144:12345-192.168.202.15@tcp:35:umount.0 Request processed in 484us (793us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787782901.544577:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 67 00000100:00100000:1.0:1787782901.547778:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782901.548029:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904614400 00000100:00100000:3.0:1787782901.548043:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904614400 00000100:00100000:3.0:1787782901.548152:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:3.0:1787782901.548164:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c310619b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+20:12314:x1874625904614400:12345-192.168.202.15@tcp:35:umount.0 00000100:00100000:3.0:1787782901.550093:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c310619b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+21:12314:x1874625904614400:12345-192.168.202.15@tcp:35:umount.0 Request processed in 1918us (2321us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787782901.550128:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 68 00000100:00100000:2.0:1787782901.559352:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782901.559452:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904614656 00000100:00100000:3.0:1787782901.559465:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904614656 00000100:00100000:3.0:1787782901.559545:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:3.0:1787782901.559558:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+21:12314:x1874625904614656:12345-192.168.202.15@tcp:35:umount.0 00000100:00100000:3.0:1787782901.560040:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+22:12314:x1874625904614656:12345-192.168.202.15@tcp:35:umount.0 Request processed in 482us (707us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787782901.560050:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 69 00000100:00100000:1.0:1787782901.564871:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782901.564917:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782901.564964:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782901.565004:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904614784 00000100:00100000:0.0:1787782901.565018:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904614784 00000100:00100000:0.0:1787782901.565125:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904615040 00000100:00100000:0.0:1787782901.565129:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904615040 00000100:00100000:0.0:1787782901.565144:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904614912 00000100:00100000:0.0:1787782901.565167:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904614912 00000100:00100000:0.0:1787782901.565191:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:0.0:1787782901.565202:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ceacfe35-7480-471c-a7cd-7a05a1613220+15:2352:x1874625904614784:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782901.565223:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787782901.565249:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:3.0:1787782901.565261:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ceacfe35-7480-471c-a7cd-7a05a1613220+15:2352:x1874625904615040:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782901.565273:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782901.565293:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3141254a00/0x6d98ed19b63728b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52de expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782901.565326:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782901.565410:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ceacfe35-7480-471c-a7cd-7a05a1613220+14:2352:x1874625904615040:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 152us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782901.565419:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:3.0:1787782901.565440:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00010000:00010000:0.0:1787782901.565442:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3141255600/0x6d98ed19b6370a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5213 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782901.565447:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ceacfe35-7480-471c-a7cd-7a05a1613220+13:2352:x1874625904614912:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787782901.565454:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787782901.565455:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782901.565464:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31013a0400/0x6d98ed19b637007 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e51db expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782901.565473:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782901.565475:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ceacfe35-7480-471c-a7cd-7a05a1613220+11:2352:x1874625904614784:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 276us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782901.565482:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:3.0:1787782901.565486:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ceacfe35-7480-471c-a7cd-7a05a1613220+11:2352:x1874625904614912:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 40us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782901.565491:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:1.0:1787782901.570498:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782901.570608:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904615168 00000100:00100000:3.0:1787782901.570623:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904615168 00000100:00100000:3.0:1787782901.570723:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 72 00000100:00100000:3.0:1787782901.570736:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+5:2348:x1874625904615168:12345-192.168.202.15@tcp:9:umount.0 00000020:00000080:3.0:1787782901.570783:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b637379 00000100:00080000:3.0:1787782901.570798:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8c3107f9d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787782901.570876:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787782901.571484:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e4b0e72-6952-496d-b228-ab2778cd786f+2:2348:x1874625904615168:12345-192.168.202.15@tcp:9:umount.0 Request processed in 748us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782901.571494:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 72 00010000:00010000:1.0:1787782901.571567:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782901.576384:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782901.576511:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904615552 00000100:00100000:1.0:1787782901.576525:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904615552 00000100:00100000:1.0:1787782901.576607:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 73 00000100:00100000:1.0:1787782901.576619:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2348:x1874625904615552:12345-192.168.202.15@tcp:9:umount.0 00000020:00000080:1.0:1787782901.576685:0:6698:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b6375da 00000020:00010000:1.0:1787782901.576698:0:6698:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c3106df3800: total 0 00000100:00080000:1.0:1787782901.576705:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8c3106df2800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787782901.576762:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:3.0:1787782901.577136:0:5839:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c3106df3800: total 0 00010000:00010000:3.0:1787782901.577220:0:5839:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c3106df3800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787782901.577301:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005416bc48/0x6d98ed19b63797d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54b3 expref: 6 pid: 6967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782901.577342:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2d249e5/0x6d98ed19b63801b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5681 expref: 5 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782901.577358:0:5839:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c3106df3800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787782901.577373:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782901.577375:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782901.577377:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782901.578081:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+2:2348:x1874625904615552:12345-192.168.202.15@tcp:9:umount.0 Request processed in 1457us (1706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782901.578121:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 73 00000100:00100000:0.0:1787782901.592358:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782901.592598:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904616576 00000100:00100000:3.0:1787782901.592613:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904616576 00000100:00100000:3.0:1787782901.592780:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 240 00000100:00100000:3.0:1787782901.592793:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+22:2348:x1874625904616576:12345-192.168.202.15@tcp:39:umount.0 00000020:00000080:3.0:1787782901.592848:0:5853:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b637015 00000020:00010000:3.0:1787782901.592872:0:5853:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c313e590800: total 0 00000100:00080000:3.0:1787782901.592878:0:5853:0:(import.c:65:import_set_state_nolock()) ffff8c31342db000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787782901.592920:0:5853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1787782901.593258:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c313e590800: total 0 00010000:00010000:1.0:1787782901.593317:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c313e590800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787782901.593365:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:1.0:1787782901.593370:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787782901.593381:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1a00/0x6d98ed19b63785e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5466 expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782901.593408:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312eeef200) 00010000:00010000:1.0:1787782901.593430:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787782901.593436:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204a00/0x6d98ed19b6379df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54cf expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782901.593455:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c312eeef700) 00010000:00010000:1.0:1787782901.593458:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787782901.593462:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6800/0x6d98ed19b6372fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52f3 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782901.593482:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:1.0:1787782901.593484:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782901.593488:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b63793e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e549e expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782901.593587:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:1.0:1787782901.593589:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787782901.593593:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc6400/0x6d98ed19b637fdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e566c expref: 17 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782901.593602:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:1.0:1787782901.593603:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787782901.593606:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a1c00/0x6d98ed19b638006 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e567a expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782901.593614:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c3104d6ef00) 00010000:00010000:1.0:1787782901.593616:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787782901.593618:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31013a0e00/0x6d98ed19b6372df lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52ec expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782901.593656:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c3108738900) 00010000:00010000:1.0:1787782901.593659:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787782901.594457:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b637968 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54ac expref: 14 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782901.594645:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782901.594648:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787782901.594652:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7a00/0x6d98ed19b637cda lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e55a8 expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782901.595065:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:1.0:1787782901.595068:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787782901.595075:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312f295e00/0x6d98ed19b63734f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5308 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782901.595093:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c312eeefc00) 00010000:00010000:1.0:1787782901.595174:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787782901.595179:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b637efc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5634 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782901.595200:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c3108738700) 00010000:00010000:1.0:1787782901.595203:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787782901.595206:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254000/0x6d98ed19b63763c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e53da expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782901.595221:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c312eeefe00) 00010000:00010000:1.0:1787782901.595224:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787782901.595244:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3140cc7e00/0x6d98ed19b6379fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e54d6 expref: 9 pid: 6719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782901.595262:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c313e590800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787782901.595296:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782901.595299:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782901.595303:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782901.596074:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e4b0e72-6952-496d-b228-ab2778cd786f+7:2348:x1874625904616576:12345-192.168.202.15@tcp:39:umount.0 Request processed in 3278us (3724us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787782901.596091:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 240 00010000:00010000:1.0:1787782902.116426:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782903.138304:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787782903.504658:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e4b0e72-6952-496d-b228-ab2778cd786f 00000020:00000080:1.0:1787782903.504672:0:7650:0:(genops.c:885:class_export_put()) final put ffff8c3107f9f000/6e4b0e72-6952-496d-b228-ab2778cd786f 00000020:00000080:3.0:1787782903.505701:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3107f9f000/6e4b0e72-6952-496d-b228-ab2778cd786f for lustre-OST0001 00000020:00000080:3.0:1787782903.505789:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3107f9d000 for lustre-OST0001 00000100:00100000:3.0:1787782903.672969:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782903.673158:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782903.673222:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904616704 00000100:00100000:2.0:1787782903.673241:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904616704 00000100:00100000:2.0:1787782903.673310:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904616832 00000100:00100000:2.0:1787782903.673313:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904616832 00000100:00100000:2.0:1787782903.673334:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:2.0:1787782903.673344:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cca92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ceacfe35-7480-471c-a7cd-7a05a1613220+11:2352:x1874625904616704:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782903.673365:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782903.673397:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31013a1200/0x6d98ed19b6370e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5228 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782903.673420:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782903.673496:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cca92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ceacfe35-7480-471c-a7cd-7a05a1613220+10:2352:x1874625904616704:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 152us (2296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782903.673505:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:2.0:1787782903.673525:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:2.0:1787782903.673532:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ceacfe35-7480-471c-a7cd-7a05a1613220+9:2351:x1874625904616832:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787782903.673539:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782903.673549:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31421fda00/0x6d98ed19b6370ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5252 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782903.673559:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782903.673576:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102e13c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ceacfe35-7480-471c-a7cd-7a05a1613220+8:2351:x1874625904616832:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 45us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782903.673582:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:2.0:1787782903.674923:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782903.674995:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904616960 00000100:00100000:3.0:1787782903.675004:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904616960 00000100:00100000:3.0:1787782903.675129:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:3.0:1787782903.675141:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ceacfe35-7480-471c-a7cd-7a05a1613220+8:2349:x1874625904616960:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787782903.675155:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782903.675171:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c312f294a00/0x6d98ed19b637284 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e52d7 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782903.675190:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782903.675232:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ceacfe35-7480-471c-a7cd-7a05a1613220+7:2349:x1874625904616960:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 94us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782903.675240:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:2.0:1787782903.678974:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782903.679224:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904617216 00000100:00100000:0.0:1787782903.679238:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904617216 00000100:00100000:0.0:1787782903.679388:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 241 00000100:00100000:0.0:1787782903.679411:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+6:2348:x1874625904617216:12345-192.168.202.15@tcp:39:umount.0 00000020:00000080:0.0:1787782903.679467:0:5851:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b6370fc 00000020:00010000:0.0:1787782903.679478:0:5851:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c3133fc6800: total 0 00000100:00080000:0.0:1787782903.679484:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8c3133fc1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787782903.679522:0:5851:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1787782903.679830:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28cc7fcc-b12d-4e30-832a-e0699e918bd2+5:2348:x1874625904617216:12345-192.168.202.15@tcp:39:umount.0 Request processed in 430us (869us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787782903.679840:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 241 00000020:00010000:3.0:1787782903.680897:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c3133fc6800: total 0 00010000:00010000:3.0:1787782903.680906:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782903.680979:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c3133fc6800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787782903.681024:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312eeef200) 00010000:00010000:3.0:1787782903.681030:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787782903.681044:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205a00/0x6d98ed19b638029 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5688 expref: 4 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782903.681074:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c3133fc6800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787782903.681086:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782903.681088:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782903.681090:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787782903.682782:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787782903.711232:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782903.711360:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904617472 00000100:00100000:0.0:1787782903.711373:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904617472 00000100:00100000:0.0:1787782903.711505:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 312 00000100:00100000:0.0:1787782903.711516:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+7:2348:x1874625904617472:12345-192.168.202.15@tcp:251:umount.0 00000020:00000080:0.0:1787782903.711627:0:5844:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636ff2 00000020:00010000:0.0:1787782903.711645:0:5844:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c313e596800: total 0 00000100:00080000:0.0:1787782903.711881:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8c313e596000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787782903.711982:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceacfe35-7480-471c-a7cd-7a05a1613220+3:2348:x1874625904617472:12345-192.168.202.15@tcp:251:umount.0 Request processed in 467us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782903.711992:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 312 00000020:00010000:1.0:1787782903.712068:0:6712:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c313e596800: total 0 00010000:00010000:1.0:1787782903.712154:0:6712:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c313e596800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787782903.712193:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c312f295200/0x6d98ed19b6370a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e521a expref: 2 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782903.712213:0:6712:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c313e596800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787782903.712220:0:6712:0:(genops.c:885:class_export_put()) final put ffff8c313e596800/ceacfe35-7480-471c-a7cd-7a05a1613220 00010000:00010000:1.0:1787782903.712234:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782903.712237:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782903.712239:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787782903.712250:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313e596800/ceacfe35-7480-471c-a7cd-7a05a1613220 for MGS 00000020:00000080:1.0:1787782903.712291:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c313e596000 for MGS 00010000:00010000:2.0:1787782904.161306:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782904.418302:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922423552:0@lo:400:kworker.0 00000100:00100000:3.0:1787782904.418377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782904.418436:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787782904.418442:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922423680:0@lo:400:kworker.0 00000100:00100000:3.0:1787782904.418479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782904.418522:0:6719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922423552 00000100:00100000:3.0:1787782904.418529:0:6719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922423552 00000100:00100000:3.0:1787782904.418586:0:6719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787782904.418596:0:6719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cca8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922423552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782904.419010:0:6719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cca8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922423552:12345-0@lo:400:kworker.0 Request processed in 415us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782904.419019:0:6719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787782904.419045:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922423680 00000100:00100000:3.0:1787782904.419049:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922423680 00000100:00100000:3.0:1787782904.419076:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787782904.419083:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cca9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922423680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782904.419139:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cca9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922423680:12345-0@lo:400:kworker.0 Request processed in 56us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782904.419147:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:3.0:1787782904.419163:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787782904.419168:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782904.419204:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922423680:0@lo:400:kworker.0 00000100:00100000:3.0:1787782904.419215:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922423552:0@lo:400:kworker.0 00000100:00100000:0.0:1787782904.419324:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cca9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922423296:0@lo:400:kworker.0 00000100:00100000:0.0:1787782904.419359:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782904.419392:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccaa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922423808:0@lo:400:kworker.0 00000100:00100000:0.0:1787782904.419415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782904.419433:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787782904.419439:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922423424:0@lo:400:kworker.0 00000100:00100000:0.0:1787782904.419463:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782904.419477:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cca9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922423936:0@lo:400:kworker.0 00000100:00100000:0.0:1787782904.419497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782904.419530:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922423808 00000100:00100000:0.0:1787782904.419534:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922423808 00000100:00100000:0.0:1787782904.419559:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922423424 00000100:00100000:0.0:1787782904.419561:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922423424 00000100:00100000:0.0:1787782904.419576:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787782904.419582:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922423808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782904.419634:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874625922423808:12345-0@lo:400:kworker.0 Request processed in 51us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782904.419641:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787782904.419732:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787782904.419738:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922423424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787782904.419778:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922423424:12345-0@lo:400:kworker.0 Request processed in 40us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782904.419785:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787782904.419811:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922423424:0@lo:400:kworker.0 00000100:00100000:0.0:1787782904.419820:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccaa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922423808:0@lo:400:kworker.0 00000100:00100000:3.0:1787782904.419872:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922423296 00000100:00100000:3.0:1787782904.419876:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922423296 00000100:00100000:3.0:1787782904.419912:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1787782904.419919:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31090f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922423296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782904.419971:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31090f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922423296:12345-0@lo:400:kworker.0 Request processed in 53us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782904.419977:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00080000:3.0:1787782904.420014:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787782904.420129:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cca9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922423296:0@lo:400:kworker.0 00000100:00100000:2.0:1787782904.420348:0:6967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922423936 00000100:00100000:2.0:1787782904.420353:0:6967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922423936 00000100:00100000:2.0:1787782904.420428:0:6967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787782904.420436:0:6967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922423936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782904.420479:0:6967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922423936:12345-0@lo:400:kworker.0 Request processed in 44us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782904.420485:0:6967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787782904.420514:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cca9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922423936:0@lo:400:kworker.0 00000100:00080000:0.0:1787782904.425889:0:5847:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1787782904.866333:0:11692:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787782904.866343:0:11692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787782904.866943:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787782904.866951:0:11692:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787782904.929383:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787782904.929406:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922424064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787782904.929489:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782904.929744:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922424192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787782904.929772:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782904.929853:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922424064 00000100:00100000:1.0:1787782904.929860:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922424064 00000100:00100000:1.0:1787782904.929907:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922424192 00000100:00100000:1.0:1787782904.929910:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922424192 00000100:00100000:1.0:1787782904.929925:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787782904.929934:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922424064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787782904.929968:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782904.930028:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922424064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782904.930035:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787782904.930051:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787782904.930056:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922424192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787782904.930076:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787782904.930121:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922424192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782904.930127:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787782904.930166:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922424192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787782904.930178:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922424064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787782905.185209:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787782905.325687:0:12926:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787782905.345544:0:12926:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787782905.345609:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63707e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.345624:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b63707e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.345632:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b63707e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.345639:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b63707e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.345668:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787782905.345674:0:12926:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787782905.345698:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787782905.345714:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787782905.345721:0:12926:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787782905.345745:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8c3132184000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787782905.345907:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625922424320:0@lo:39:umount.0 00010000:00010000:3.0:1787782905.345951:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782905.345960:0:6712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b63707e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.345969:0:6712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fd000 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782905.345973:0:6712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b63707e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.345982:0:6712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d98ed19b63707e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782905.345987:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1787782905.345997:0:6712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d98ed19b63707e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782905.346004:0:6712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787782905.346007:0:6712:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787782905.346009:0:6712:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787782905.346037:0:6712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b63707e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.346045:0:6712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782905.346061:0:6712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b63707e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.346068:0:6712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31421fd000/0x6d98ed19b637077 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b63707e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.346083:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782905.346092:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782905.346208:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922424320 00000100:00100000:2.0:1787782905.346216:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922424320 00000100:00100000:2.0:1787782905.346274:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787782905.346284:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625922424320:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787782905.346308:0:5851:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636e01 00000100:00080000:2.0:1787782905.346318:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8c3106920000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787782905.346401:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1874625922424320:12345-0@lo:39:umount.0 Request processed in 118us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782905.346410:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1787782905.346422:0:5851:0:(genops.c:885:class_export_put()) final put ffff8c3106927000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1787782905.346451:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cca9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922424448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782905.346486:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787782905.346560:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787782905.346570:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3106927000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787782905.346645:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3106920000 for lustre-MDT0000 00000100:00100000:2.0:1787782905.346662:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922424448 00000100:00100000:2.0:1787782905.346666:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922424448 00000100:00100000:2.0:1787782905.346706:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787782905.346715:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346ff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+19:3306:x1874625922424448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782905.346737:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782905.346753:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c312f294e00/0x6d98ed19b63707e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d98ed19b637077 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782905.346768:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782905.346804:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346ff840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+18:3306:x1874625922424448:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782905.346811:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787782905.346857:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cca9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922424448:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782905.346942:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787782905.347165:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c3132184000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787782905.347176:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625922424320:0@lo:39:umount.0 00000100:00080000:1.0:1787782905.347652:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787782905.347655:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787782905.347660:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787782905.351369:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63708c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.351387:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b63708c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.351395:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b63708c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.351401:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b63708c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.351425:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782905.351431:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636fb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.351438:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636fb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.351445:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b636fb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.351452:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b636fb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.351485:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787782905.351492:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6372b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.351494:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787782905.351502:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b6372b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.351507:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b63708c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.351509:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b6372b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.351525:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b6372b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.351538:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255a00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782905.351543:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b63708c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.351546:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787782905.351557:0:12926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3100031600/0x6d98ed19b636d60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b636d67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.351558:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d98ed19b63708c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.351575:0:12926:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3100031600/0x6d98ed19b636d60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b636d67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782905.351578:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d98ed19b63708c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.351592:0:12926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3100031600/0x6d98ed19b636d60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b636d67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782905.351593:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787782905.351608:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787782905.351615:0:12926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff8c3100031600/0x6d98ed19b636d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b636d67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782905.351624:0:12926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1787782905.351628:0:12926:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787782905.351633:0:12926:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1787782905.351645:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b63708c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.351653:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:1.0:1787782905.351665:0:12926:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787782905.351670:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:3.0:1787782905.351674:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b63708c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787782905.351674:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787782905.351681:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00010000:00010000:3.0:1787782905.351685:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b637085 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b63708c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787782905.351690:0:12926:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c313438b800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787782905.351701:0:12926:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c313c93a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1787782905.351709:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00080000:1.0:1787782905.351709:0:12926:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8c3133fc6800 28cc7fcc-b12d-4e30-832a-e0699e918bd2 192.168.202.15@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1787782905.351716:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b636fb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787782905.351719:0:12926:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8c313e590800 6e4b0e72-6952-496d-b228-ab2778cd786f 192.168.202.15@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:1.0:1787782905.351731:0:12926:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8c31091eb370) has exports, disconnecting them 00000020:00080000:1.0:1787782905.351735:0:12926:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c313438b800), last request at 1787782904 00000020:00000080:1.0:1787782905.351743:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636f74 00000100:00080000:1.0:1787782905.351760:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8c313438a800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787782905.351804:0:12926:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c313438b800): rc 0 00000020:00000080:1.0:1787782905.351807:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c313438b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787782905.351820:0:12926:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c313c93a800), last request at 1787782904 00000020:00000080:1.0:1787782905.351824:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636ea9 00000100:00080000:1.0:1787782905.351830:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8c313c93d000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787782905.351838:0:12926:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c313c93a800): rc 0 00000020:00000080:1.0:1787782905.351840:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c313c93a800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1787782905.351848:0:12926:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb0afc0d7fae0 00000100:00100000:2.0:1787782905.351865:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922424576:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787782905.351868:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787782905.351874:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1787782905.351888:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787782905.351949:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787782905.351961:0:12926:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787782905.351974:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8c3001e12800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787782905.351987:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787782905.351990:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787782905.352000:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787782905.352023:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922424576 00000100:00100000:2.0:1787782905.352030:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922424576 00000100:00080000:1.0:1787782905.352075:0:12926:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1787782905.352082:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787782905.352087:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8c31061ee800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787782905.352112:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db359560-8e1a-42c0-a155-5e020d83d9a3+18:3307:x1874625922424576:12345-0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787782905.352148:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8c31091eb370) has no exports 00010000:00010000:3.0:1787782905.352162:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0200 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782905.352166:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b636fb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.352173:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d98ed19b636fb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782905.352573:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922424704:0@lo:9:umount.0 00000100:00100000:0.0:1787782905.352621:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782905.352653:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922424832:0@lo:9:umount.0 10000000:00010000:3.0:1787782905.352672:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d98ed19b636fb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782905.352680:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1787782905.352686:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787782905.352689:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787782905.352692:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787782905.352713:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b636fb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782905.352717:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922424704 00010000:00010000:3.0:1787782905.352720:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787782905.352730:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922424704 00010000:00010000:3.0:1787782905.352740:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b636fb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.352748:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31013a0200/0x6d98ed19b636fac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b636fb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.352767:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1787782905.352767:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922424832 00010000:00010000:3.0:1787782905.352772:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b6372b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.352778:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0800 already unused, calling callback (ffffffffc1a18c20) 00000100:00100000:0.0:1787782905.352781:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922424832 10000000:00010000:3.0:1787782905.352783:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b6372b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.352799:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d98ed19b6372b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782905.352805:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d98ed19b6372b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782905.352807:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 10000000:01000000:3.0:1787782905.352816:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787782905.352818:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625922424704:12345-0@lo:9:umount.0 10000000:01000000:3.0:1787782905.352820:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787782905.352825:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787782905.352842:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b6372b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1787782905.352842:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636ef6 00010000:00010000:3.0:1787782905.352851:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1787782905.352852:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8c3001fd0800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787782905.352860:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b6372b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.352868:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31013a0800/0x6d98ed19b6372ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b6372b5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.352878:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000001:00000004:0.0:1787782905.352880:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:3.0:1787782905.352882:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3100031600/0x6d98ed19b636d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b636d67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.352890:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3100031600 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782905.352894:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3100031600/0x6d98ed19b636d60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b636d67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.352902:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3100031600/0x6d98ed19b636d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d98ed19b636d67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782905.352920:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3100031600/0x6d98ed19b636d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d98ed19b636d67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782905.352926:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787782905.352928:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787782905.352929:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787782905.352943:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3100031600/0x6d98ed19b636d60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b636d67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.352949:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782905.352960:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3100031600/0x6d98ed19b636d60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b636d67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.352967:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3100031600/0x6d98ed19b636d60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b636d67 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782905.352977:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782905.352979:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782905.352981:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782905.352992:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922424960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782905.353021:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782905.353048:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787782905.353053:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922425088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782905.353074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1787782905.353123:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313438b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787782905.353164:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313c93a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787782905.353187:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c313438a800 for lustre-MDT0000 00000020:00000080:3.0:1787782905.353192:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c313c93d000 for lustre-MDT0000 00000100:00100000:0.0:1787782905.353456:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3303:x1874625922424704:12345-0@lo:9:umount.0 Request processed in 639us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782905.353464:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787782905.353479:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787782905.353485:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874625922424832:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787782905.353497:0:6697:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636fdd 00000100:00080000:0.0:1787782905.353502:0:6697:0:(import.c:65:import_set_state_nolock()) ffff8c3132187800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787782905.353521:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:2.0:1787782905.353607:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782905.353626:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31029f4800/0x6d98ed19b63708c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d98ed19b637085 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782905.353639:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782905.353672:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db359560-8e1a-42c0-a155-5e020d83d9a3+17:3307:x1874625922424576:12345-0@lo:103:ldlm_bl.0 Request processed in 1582us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782905.353680:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787782905.353698:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922424960 00000100:00100000:2.0:1787782905.353702:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922424960 00000100:00100000:2.0:1787782905.353729:0:7637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922425088 00000100:00100000:2.0:1787782905.353733:0:7637:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922425088 00000100:00100000:2.0:1787782905.353766:0:7637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787782905.353775:0:7637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cca8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db359560-8e1a-42c0-a155-5e020d83d9a3+18:3304:x1874625922424960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782905.353784:0:7637:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782905.353794:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3100030e00/0x6d98ed19b636fb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d98ed19b636fac expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782905.353807:0:7637:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782905.353810:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3303:x1874625922424832:12345-0@lo:9:umount.0 Request processed in 323us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782905.353819:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787782905.353844:0:7637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cca8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:db359560-8e1a-42c0-a155-5e020d83d9a3+17:3304:x1874625922424960:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782905.353851:0:7637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787782905.353857:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787782905.353867:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cca8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+16:3304:x1874625922425088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787782905.353876:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782905.353888:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c312f294c00/0x6d98ed19b6372b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d98ed19b6372ae expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782905.353898:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782905.353949:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782905.353978:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922425088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782905.353987:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:db359560-8e1a-42c0-a155-5e020d83d9a3:3304:1874625922424960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782905.354029:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922425216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782905.354054:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782905.354086:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922424576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787782905.354128:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922425216 00000100:00100000:2.0:1787782905.354131:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922425216 00000100:00100000:2.0:1787782905.354154:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787782905.354160:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+16:3306:x1874625922425216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782905.354168:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787782905.354176:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31029f5800/0x6d98ed19b636d67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d98ed19b636d60 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782905.354187:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787782905.354225:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:db359560-8e1a-42c0-a155-5e020d83d9a3+15:3306:x1874625922425216:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782905.354239:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787782905.354274:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:db359560-8e1a-42c0-a155-5e020d83d9a3:3306:1874625922425216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782905.354550:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cca8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:db359560-8e1a-42c0-a155-5e020d83d9a3+14:3304:x1874625922425088:12345-0@lo:103:ldlm_bl.0 Request processed in 684us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782905.354567:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1787782905.354657:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787782905.354679:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c3001e12800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787782905.354698:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787782905.354701:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787782905.354704:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922424704:0@lo:9:umount.0 00000100:00080000:0.0:1787782905.354717:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c31061ee800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787782905.354728:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787782905.354730:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787782905.354732:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922424832:0@lo:9:umount.0 00010000:00010000:0.0:1787782905.354758:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787782905.365318:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8c31091eb370) has no exports 00000020:00000080:1.0:1787782905.414454:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636dbb 00000020:00000080:1.0:1787782905.414474:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c313cd6a000/lustre-QMT0000_UUID 00000020:01000000:1.0:1787782905.414487:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787782905.414588:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782905.414607:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787782905.414612:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8c313cd60000) has no exports 00000020:00000080:3.0:1787782905.414896:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313cd6a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787782905.415815:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636db4 00000020:00000080:0.0:1787782905.415824:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c313cc3e000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787782905.415893:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313cc3e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787782905.416009:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782905.416018:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787782905.416022:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c313cd6e000/lustre-QMT0000_UUID 00000020:00000080:0.0:1787782905.416025:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313cd6e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787782905.416033:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:3.0:1787782906.017371:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787782906.017380:0:6723:0:(genops.c:885:class_export_put()) final put ffff8c3001fd3000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787782906.017411:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e4b0e72-6952-496d-b228-ab2778cd786f 00000020:00000080:3.0:1787782906.017414:0:6723:0:(genops.c:885:class_export_put()) final put ffff8c3106df3800/6e4b0e72-6952-496d-b228-ab2778cd786f 00000020:00000080:3.0:1787782906.017430:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3001fd3000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787782906.017472:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3106df3800/6e4b0e72-6952-496d-b228-ab2778cd786f for lustre-OST0000 00000020:00000080:3.0:1787782906.017490:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3001fd0800 for lustre-OST0000 00000020:00000080:3.0:1787782906.017494:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3106df2800 for lustre-OST0000 00000001:00100000:1.0:1787782906.024724:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 28cc7fcc-b12d-4e30-832a-e0699e918bd2 00000001:00080000:1.0:1787782906.024736:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1787782906.024740:0:5874:0:(genops.c:885:class_export_put()) final put ffff8c3133fc6800/28cc7fcc-b12d-4e30-832a-e0699e918bd2 00000001:00100000:1.0:1787782906.024762:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e4b0e72-6952-496d-b228-ab2778cd786f 00000001:00080000:1.0:1787782906.024766:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1787782906.024774:0:5874:0:(genops.c:885:class_export_put()) final put ffff8c313e590800/6e4b0e72-6952-496d-b228-ab2778cd786f 00000020:00000080:3.0:1787782906.024801:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3133fc6800/28cc7fcc-b12d-4e30-832a-e0699e918bd2 for lustre-MDT0000 00000020:00000080:3.0:1787782906.024853:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313e590800/6e4b0e72-6952-496d-b228-ab2778cd786f for lustre-MDT0000 00000020:00000080:3.0:1787782906.024886:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3133fc1800 for lustre-MDT0000 00000020:00000080:3.0:1787782906.024892:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c31342db000 for lustre-MDT0000 00010000:00010000:2.0:1787782906.210352:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782907.233420:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787782907.425303:0:12926:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c3134320840 - data ffff8c30034341b0/ffff8c312f3c6c00 00000020:01000000:0.0:1787782907.425505:0:12926:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c313cd1bea0 - data ffff8c310f469948/ffff8c3133fbd000 00000001:00000004:0.0:1787782907.431568:0:12926:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1787782907.568593:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787782907.568601:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787782907.569014:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787782907.569017:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787782907.583613:0:6958:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787782907.583623:0:6958:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1787782907.583634:0:6958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787782907.595966:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787782907.595975:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1787782907.595997:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787782907.595999:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787782907.596590:0:8010:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787782907.596596:0:8010:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1787782907.596609:0:8010:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787782907.721550:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636d83 00000020:00000080:0.0:1787782907.721563:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c3133f74000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787782907.721665:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3133f74000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787782907.731833:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636d98 00000020:00000080:0.0:1787782907.731850:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c313cd6c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787782907.731870:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787782907.731875:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782907.731884:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787782907.731888:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8c31091ecd28) has no exports 00000004:01000000:0.0:1787782907.732065:0:12926:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787782907.732074:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636fd6 00000020:00000080:0.0:1787782907.732079:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c31342d9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787782907.732083:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787782907.732087:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782907.732122:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787782907.732125:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8c3134383370) has no exports 00000020:00000080:0.0:1787782907.732132:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636fcf 00000020:00000080:0.0:1787782907.732137:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c31061ee000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787782907.732425:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313cd6c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1787782907.732436:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c31342d9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787782907.732441:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c31061ee000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787782907.732713:0:12926:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787782907.732717:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787782907.732722:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1787782907.732728:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787782907.732730:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787782907.732815:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c31061ee800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787782907.732986:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782907.732994:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787782907.732999:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c3134388800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787782907.733001:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3134388800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787782907.733007:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787782907.733089:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636eef 00000020:00000080:0.0:1787782907.733127:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c3001fd5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787782907.733135:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787782907.733139:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782907.733143:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787782907.733146:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8c311841b370) has no exports 00000020:00000080:0.0:1787782907.733151:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636ee8 00000020:00000080:0.0:1787782907.733154:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c3001e13800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787782907.733256:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3001fd5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787782907.733273:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3001e13800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787782907.733988:0:12926:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787782907.733998:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787782907.734001:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1787782907.734006:0:12926:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787782907.734007:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787782907.734046:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782907.734054:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787782907.734084:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782907.734087:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787782907.734091:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c3133f72000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787782907.734115:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3133f72000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787782907.734120:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787782907.734291:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636d9f 00000020:00000080:0.0:1787782907.734297:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c313cd68000/lustre-MDD0000_UUID 00000020:01000000:0.0:1787782907.734302:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787782907.734306:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782907.734310:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787782907.734313:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8c313cd63370) has no exports 00000020:00000080:0.0:1787782907.734334:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782907.734777:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3001e12800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787782907.734788:0:8:0:(genops.c:885:class_export_put()) final put ffff8c3001e10000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787782907.734791:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3001e10000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787782907.734795:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787782907.734885:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313cd68000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787782907.734940:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787782907.734943:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c3133f73800/lustre-MDD0000_UUID 00000020:00000080:0.0:1787782907.734945:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3133f73800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787782907.734951:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1787782907.735493:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636da6 00000020:00000080:0.0:1787782907.735499:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c313cd6d800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787782907.735554:0:12926:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c311846c800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787782907.735558:0:12926:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c311846c800 3 00000020:01000004:0.0:1787782907.735562:0:12926:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c311846c800 from lustre-MDT0000 00000020:00000080:0.0:1787782907.735594:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782907.735598:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787782907.735601:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c3133f70000/lustre-MDT0000_UUID 00000020:00000080:0.0:1787782907.735603:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3133f70000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787782907.735610:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787782907.735643:0:12926:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787782907.735648:0:12926:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787782907.735651:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787782907.735655:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782907.735659:0:12926:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787782907.735667:0:12926:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8c3110730000 db359560-8e1a-42c0-a155-5e020d83d9a3 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787782907.735673:0:12926:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8c310829b370) has exports, disconnecting them 00000020:00080000:0.0:1787782907.735678:0:12926:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8c3110730000), last request at 1787782660 00000020:00000080:0.0:1787782907.735698:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636d44 00000020:00010000:0.0:1787782907.735704:0:12926:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c3110730000: total 1 00000100:00080000:0.0:1787782907.735710:0:12926:0:(import.c:65:import_set_state_nolock()) ffff8c3110731000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787782907.735736:0:12926:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c3110730000): rc 0 00000020:00080000:0.0:1787782907.735741:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8c310829b370) has no exports 00000100:00100000:0.0:1787782907.735799:0:5844:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8c312a013200:5844] 0 exiting: rc = 1 00000020:00010000:1.0:1787782907.735938:0:5838:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c3110730000: total 1 00010000:00010000:1.0:1787782907.735973:0:5838:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c3110730000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787782907.736009:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31029f5e00/0x6d98ed19b637062 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d98ed19b63705b expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782907.736027:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31421fd400/0x6d98ed19b637054 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d98ed19b63704d expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782907.736038:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3141254800/0x6d98ed19b637070 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d98ed19b637069 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782907.736059:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c312f294600/0x6d98ed19b6372a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d98ed19b6372a0 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782907.736069:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31421fcc00/0x6d98ed19b63709a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d98ed19b637093 expref: 5 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782907.736078:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3141255400/0x6d98ed19b637299 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d98ed19b637292 expref: 4 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782907.736092:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3100030a00/0x6d98ed19b636e5c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d98ed19b636e55 expref: 3 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782907.736126:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31029f5000/0x6d98ed19b637046 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x6d98ed19b63703f expref: 2 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782907.736136:0:5838:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c3110730000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787782907.736149:0:5838:0:(genops.c:885:class_export_put()) final put ffff8c3110730000/db359560-8e1a-42c0-a155-5e020d83d9a3 00000100:00100000:0.0:1787782907.736192:0:5846:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8c3106935e00:5846] 2 exiting: rc = 0 00000100:00100000:0.0:1787782907.737825:0:5845:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8c310821a800:5845] 1 exiting: rc = 0 00000100:00100000:0.0:1787782907.737941:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.737954:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.737961:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.737967:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.737972:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.737978:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.737984:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.737990:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.737996:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738003:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738008:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738014:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738019:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738024:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738030:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738036:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738042:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738069:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738074:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738080:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738085:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738091:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738117:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738125:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738130:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738135:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738140:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738144:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738149:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738156:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738161:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738167:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738172:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738179:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738185:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738191:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738196:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738201:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738206:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738212:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738216:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738221:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738226:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738231:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738241:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738247:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738251:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738257:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738272:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738278:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738283:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738289:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738301:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738307:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738313:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738318:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738324:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738329:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738345:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738352:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738358:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738364:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738369:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.738375:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1787782907.738954:0:12926:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787782907.738958:0:12926:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:3.0:1787782907.740773:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313cd6d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1787782907.742029:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782907.742034:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782907.742038:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787782907.742182:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3110730000/db359560-8e1a-42c0-a155-5e020d83d9a3 for MGS 00000020:00000080:3.0:1787782907.742254:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3110731000 for MGS 00000020:01000000:3.0:1787782907.742309:0:12926:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c312f1730c0 - data ffff8c310f580a20/ffff8c310963cc00 00000020:01000000:3.0:1787782907.743617:0:12926:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c31184e5660 - data ffff8c312b311000/ffff8c31068ef000 00000020:00000080:3.0:1787782907.744861:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636d28 00000020:00000080:3.0:1787782907.744872:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c3118571800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787782907.744886:0:12926:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c311846c800 from MGS, refs=2 00000020:01000004:3.0:1787782907.744889:0:12926:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c311846c800 2 00000020:01000004:3.0:1787782907.744893:0:12926:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c311846c800 from MGS 00000020:00000080:1.0:1787782907.744929:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3118571800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787782907.744991:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782907.744998:0:12926:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787782907.745001:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c3118575000/MGS 00000020:00000080:3.0:1787782907.745004:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3118575000/MGS for MGS 00000020:01000000:3.0:1787782907.745010:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787782907.745071:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787782907.745074:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782907.745079:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787782907.745086:0:12926:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8c312e5eb800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787782907.745091:0:12926:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8c31184199b8) has exports, disconnecting them 00000020:00080000:3.0:1787782907.745166:0:12926:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8c312e5eb800), last request at 1787782661 00000020:00000080:3.0:1787782907.745175:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636df3 00000020:00080000:3.0:1787782907.745184:0:12926:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c312e5eb800): rc 0 00000020:00000080:3.0:1787782907.745189:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c312e5eb800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787782907.745248:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c312e5eb800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787782907.779227:0:12926:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787782907.779236:0:12926:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782907.779241:0:12926:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787782907.779249:0:12926:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787782907.779467:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782907.779476:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787782907.779483:0:12926:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c311846c800 1 00000020:00000080:0.0:1787782907.779491:0:12926:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636d1a 00000020:00000080:0.0:1787782907.779500:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c3118571000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787782907.779506:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787782907.779516:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782907.779520:0:12926:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787782907.779523:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8c310829cd28) has no exports 00000020:00000080:1.0:1787782907.782803:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3132184000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787782907.782818:0:37:0:(genops.c:885:class_export_put()) final put ffff8c312e5ea800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787782907.782822:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c312e5ea800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787782907.782836:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787782907.783254:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3118571000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787782907.818717:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787782907.818743:0:12926:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787782907.818749:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c3118577800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787782907.818753:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3118577800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787782907.818764:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787782907.818881:0:12926:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c3102f3a800 00000020:01000000:1.0:1787782907.818899:0:12926:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787782907.818902:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787782907.818906:0:12926:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787782907.818909:0:12926:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8c31091e99b8) has no exports 00000100:00100000:2.0:1787782907.819811:0:5852:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8c31082dc600:5852] 1 exiting: rc = 0 00000100:00100000:2.0:1787782907.819914:0:5851:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8c31091f5800:5851] 0 exiting: rc = 1 00000100:00100000:2.0:1787782907.819971:0:5853:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8c310911fc00:5853] 2 exiting: rc = 0 00000100:00100000:0.0:1787782907.823205:0:6719:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8c3001f86600:6719] 3 exiting: rc = 0 00000100:00100000:1.0:1787782907.823345:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823352:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823355:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823359:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823363:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823367:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823371:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823375:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823379:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823492:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823501:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823506:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823512:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823518:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823524:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823529:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823535:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823541:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823547:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823551:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823557:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823562:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823567:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823585:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823592:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823615:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823620:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823626:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823631:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823637:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823643:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823649:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823656:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823661:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823667:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823672:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823677:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823695:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823702:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823708:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823713:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823719:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823723:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823726:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823730:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823733:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823737:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823805:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823811:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823814:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823818:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823821:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823825:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823829:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823832:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823836:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823839:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823843:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823847:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823850:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823859:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823862:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823866:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.823875:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.828302:0:11490:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8c312980d600:11490] 2 exiting: rc = 0 00000100:00100000:2.0:1787782907.828639:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8c310911fe00:5854] 0 exiting: rc = 1 00000100:00100000:0.0:1787782907.836235:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8c310911e000:5855] 1 exiting: rc = 0 00000100:00100000:1.0:1787782907.836875:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836884:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836892:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836900:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836908:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836916:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836924:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836932:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836942:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836952:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836959:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836964:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836971:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836975:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836980:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836985:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836991:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.836997:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837002:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837008:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837013:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837022:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837032:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837040:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837047:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837051:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837057:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837068:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837073:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837078:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837110:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837118:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837124:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837131:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837138:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837146:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837153:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837159:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837166:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837173:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837179:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837184:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837190:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837197:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837203:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837208:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837214:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837218:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837223:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837228:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837233:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837238:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837243:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837249:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837254:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837260:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837264:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837270:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837275:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837280:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837285:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837291:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837296:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.837300:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.837839:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8c310911f400:5856] 0 exiting: rc = 1 00000100:00100000:2.0:1787782907.838088:0:12025:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8c31070fb600:12025] 2 exiting: rc = 0 00000100:00100000:1.0:1787782907.838134:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8c3109115a00:5857] 1 exiting: rc = 0 00000100:00100000:1.0:1787782907.844207:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844220:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844226:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844231:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844238:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844270:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844277:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844283:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844290:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844295:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844301:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844308:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844315:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844321:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844327:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844334:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844340:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844361:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844369:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844376:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844395:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844403:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844409:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844414:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844422:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844428:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844434:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844440:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844446:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844467:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844474:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844482:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844488:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844493:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844499:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844518:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844524:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844530:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844537:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844542:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844548:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844570:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844591:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844596:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844602:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844608:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844613:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844618:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844624:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844629:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844634:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844639:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844644:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844662:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844670:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844675:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844682:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844687:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844692:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844697:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844702:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844707:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844712:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.844721:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782907.860685:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8c3109115c00:5858] 0 exiting: rc = 1 00000100:00100000:1.0:1787782907.860685:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8c310911e800:5859] 1 exiting: rc = 0 00000100:00100000:0.0:1787782907.860890:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.860899:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.860905:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.860926:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.860934:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.860943:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.860948:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.860953:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.860958:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.860963:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.860968:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.860973:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.860978:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.860982:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.860987:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.860992:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.860997:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861002:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861007:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861012:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861017:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861022:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861028:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861033:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861038:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861043:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861049:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861054:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861059:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861065:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861070:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861075:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861080:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.861086:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862146:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862160:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862165:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862170:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862184:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862189:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862193:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862197:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862202:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862206:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862210:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862214:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862218:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862222:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862227:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862230:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862234:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862238:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862242:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862245:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862249:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862253:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862257:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862260:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862264:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862268:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862272:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862276:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862279:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862284:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782907.862681:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8c31084cec00:5861] 1 exiting: rc = 0 00000100:00100000:1.0:1787782907.862702:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8c3109115e00:5860] 0 exiting: rc = 1 00000100:00100000:0.0:1787782907.862757:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862763:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862767:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862772:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862777:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862781:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862790:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862794:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862799:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862873:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862878:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862883:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862888:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862892:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862898:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862902:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862907:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862911:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862916:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862920:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862925:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862929:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862933:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862937:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862942:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862946:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862950:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862955:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862959:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862963:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862968:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862972:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862976:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862980:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862985:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862989:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862993:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.862998:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863002:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863006:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863030:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863036:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863041:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863046:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863057:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863062:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863067:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863072:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863076:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863079:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863083:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863086:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863089:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863092:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863116:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863121:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863126:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863131:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863136:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863141:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863146:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863151:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863154:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863158:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782907.863396:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8c31084cb200:5862] 0 exiting: rc = 1 00000100:00100000:2.0:1787782907.863444:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8c31084cf200:5863] 1 exiting: rc = 0 00000100:00100000:0.0:1787782907.863483:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863490:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863495:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863500:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863505:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863510:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863515:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863521:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863526:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863534:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863539:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863543:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863546:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863549:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863553:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863562:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863565:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863568:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863587:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863592:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863595:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863598:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863602:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863605:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863608:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863611:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863614:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863617:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863620:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863623:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863625:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863628:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863631:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863634:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863637:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863639:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863642:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863645:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863648:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863651:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863655:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863658:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863660:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863663:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863666:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863669:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863671:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863674:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863677:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863680:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863687:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863690:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863693:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863696:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863700:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863703:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863706:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863709:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863712:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863715:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863718:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863720:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863723:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787782907.863726:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782907.864120:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8c31084cf600:5865] 1 exiting: rc = 0 00000100:00100000:1.0:1787782907.864199:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8c31084cee00:5864] 0 exiting: rc = 1 00000100:00100000:2.0:1787782907.864258:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8c31084d1e00:5866] 2 exiting: rc = 0 00000100:00100000:1.0:1787782907.864331:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864336:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864340:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864350:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864353:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864357:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864361:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864364:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864368:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864372:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864376:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864379:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864383:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864388:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864394:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864400:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864405:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864411:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864416:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864421:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864426:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864432:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864436:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864448:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864452:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864456:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864460:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864464:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864467:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864471:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864474:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864478:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864482:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864485:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864488:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864492:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864495:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864498:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864506:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864510:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864513:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864516:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864520:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864524:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864527:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864531:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864535:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864546:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864551:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864555:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864558:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864562:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864565:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864568:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864582:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864587:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864591:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864594:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864597:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864601:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864604:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864607:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864611:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782907.864614:0:12926:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787782907.867788:0:12926:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787782907.867800:0:12926:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787782907.867805:0:12926:0:(genops.c:885:class_export_put()) final put ffff8c3132186800/MDS_uuid 00000020:00000080:2.0:1787782907.867810:0:12926:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3132186800/MDS_uuid for MDS 00000020:01000000:2.0:1787782907.867816:0:12926:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787782907.867923:0:12926:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787782908.257394:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787782908.598973:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787782908.598982:0:7650:0:(genops.c:885:class_export_put()) final put ffff8c3132185000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787782908.599044:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3132185000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787782908.599126:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3132187800 for lustre-OST0001 00010000:00010000:3.0:1787782909.305041:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782909.548432:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922425344:0@lo:400:kworker.0 00000400:00000100:3.0:1787782909.548503:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874625922425344 offset 0 length 224: 4 00000100:00100000:2.0:1787782909.550195:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922425472:0@lo:400:kworker.0 00000400:00000100:2.0:1787782909.550241:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874625922425472 offset 0 length 224: 4 00000100:00100000:2.0:1787782909.550273:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787782909.550279:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922425600:0@lo:400:kworker.0 00000400:00000100:2.0:1787782909.550310:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874625922425600 offset 0 length 224: 4 00010000:00010000:3.0:1787782910.306653:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787782910.706723:0:13080:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787782910.733248:0:13080:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787782910.733299:0:13080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637062 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782910.733312:0:13080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b637062 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782910.733319:0:13080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b637062 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782910.733325:0:13080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b637062 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782910.733411:0:13080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787782910.733418:0:13080:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787782910.733442:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787782910.733457:0:13080:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c31346fc000 x1874625922425472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782925 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782910.733474:0:13080:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1787782910.733481:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782910.733488:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b637062 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782910.733496:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254c00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:1.0:1787782910.733499:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b637062 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782910.733516:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922425472:0@lo:400:kworker.0 00010000:00010000:1.0:1787782910.733521:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d98ed19b637062 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782910.733527:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d98ed19b637062 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782910.733532:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787782910.733535:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787782910.733537:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00080000:2.0:1787782910.733540:0:13080:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787782910.733570:0:13080:0:(import.c:65:import_set_state_nolock()) ffff8c312e5e8000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1787782910.733573:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b637062 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782910.733578:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787782910.733599:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b637062 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782910.733607:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3141254c00/0x6d98ed19b63705b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x6d98ed19b637062 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782910.733608:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1787782910.733618:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782910.733619:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782910.733621:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922425856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787782910.733621:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782910.733641:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625922425728:0@lo:39:umount.0 00000400:00000100:0.0:1787782910.733680:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874625922425728 offset 0 length 224: 4 00000100:00100000:2.0:1787782910.733692:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782910.734401:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922425856 00000100:00100000:1.0:1787782910.734409:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922425856 00000100:00100000:1.0:1787782910.734446:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787782910.734454:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102e13850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3307:x1874625922425856:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787782910.734461:0:5836:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787782910 with bad export cookie 493582665080073540 00000100:00100000:1.0:1787782910.743814:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102e13850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3307:x1874625922425856:12345-0@lo:103:ldlm_bl.0 Request processed in 9350us (10114us total) trans 0 rc -107/-107 00000100:00080000:2.0:1787782910.743848:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.115@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1787782910.743849:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1787782910.743879:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8c3132181000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787782910.743885:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.115@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1787782910.749308:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.115@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787782910.749314:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787782910.749324:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c31346ffc00 x1874625922425344/t0(0) o400->MGC192.168.202.115@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787782925 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782910.749338:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c31411d1a40 x1874625922425856/t0(0) o103->MGC192.168.202.115@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787782926 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787782910.749414:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787782910.749418:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787782910.749419:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787782910.749423:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8c3132181000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787782910.749428:0:3307:0:(import.c:510:import_select_connection()) MGC192.168.202.115@tcp: connect to NID 0@lo last attempt 145 00000100:00080000:2.0:1787782910.749437:0:3307:0:(import.c:624:import_select_connection()) MGC192.168.202.115@tcp: import ffff8c3132181000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:3.0:1787782910.749686:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c313cca8000 x1874625922425984/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787782910.749749:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:db359560-8e1a-42c0-a155-5e020d83d9a3:3303:1874625922425984:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1787782910.749800:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874625922425984 offset 0 length 520: 4 00000100:00100000:3.0:1787782910.749870:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922425344:0@lo:400:kworker.0 00000100:00100000:3.0:1787782910.749897:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:db359560-8e1a-42c0-a155-5e020d83d9a3:3307:1874625922425856:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782911.329431:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782912.354071:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782913.377674:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782914.401879:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787782914.657285:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) db359560-8e1a-42c0-a155-5e020d83d9a3->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787782914.657297:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) db359560-8e1a-42c0-a155-5e020d83d9a3->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787782914.657386:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787782914.663197:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922426112:0@lo:400:kworker.0 00000400:00000100:2.0:1787782914.663261:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874625922426112 offset 0 length 224: 4 00010000:00010000:3.0:1787782915.425320:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787782915.681228:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) db359560-8e1a-42c0-a155-5e020d83d9a3->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787782915.681238:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) db359560-8e1a-42c0-a155-5e020d83d9a3->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787782915.681403:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787782915.681426:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922426240:0@lo:400:kworker.0 00000400:00000100:3.0:1787782915.681486:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874625922426240 offset 0 length 224: 4 00010000:00010000:1.0:1787782916.457992:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782917.473292:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782918.499916:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782919.521503:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782920.289672:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782910/real 1787782910] req@ffff8c313cca8000 x1874625922425984/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787782920 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782920.289701:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c313cca8000 x1874625922425984/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787782920 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782920.289710:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782910/real 1787782910] req@ffff8c31346fc000 x1874625922425728/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787782920 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782920.289717:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c31346fc000 x1874625922425728/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787782920 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787782920.289734:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c3132181000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787782920.289756:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787782920.289778:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:db359560-8e1a-42c0-a155-5e020d83d9a3:3303:1874625922425984:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1787782920.289783:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c312e5e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787782920.289794:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625922425728:0@lo:39:umount.0 00000100:00080000:2.0:1787782920.289947:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787782920.289952:0:13080:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787782920.289957:0:13080:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787782920.290533:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) db359560-8e1a-42c0-a155-5e020d83d9a3->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787782920.290539:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787782920.290543:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c3132181000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787782920.290548:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.115@tcp: connect to NID 0@lo last attempt 395 00000100:00080000:1.0:1787782920.290554:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.115@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787782920.290560:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.115@tcp: import ffff8c3132181000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787782920.290590:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c31411d0780 x1874625922426368/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787782920.290666:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787782920.290678:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922426496:0@lo:400:kworker.0 00000400:00000100:1.0:1787782920.290728:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874625922426496 offset 0 length 224: 4 00000100:00100000:0.0:1787782920.290785:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:db359560-8e1a-42c0-a155-5e020d83d9a3:3303:1874625922426368:0@lo:250:kworker.0 00000400:00000100:0.0:1787782920.290807:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874625922426368 offset 0 length 520: 4 00010000:00010000:2.0:1787782920.295628:0:13080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637070 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782920.295647:0:13080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b637070 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782920.295652:0:13080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b637070 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782920.295671:0:13080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b637070 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782920.295689:0:13080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782920.295696:0:13080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6372a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782920.295702:0:13080:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b6372a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782920.295708:0:13080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b6372a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782920.295715:0:13080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b6372a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782920.295734:0:13080:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787782920.295739:0:13080:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787782920.295759:0:13080:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787782920.295763:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787782920.295767:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787782920.295772:0:13080:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787782920.295776:0:13080:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8c311841cd28) has no exports 00010000:00010000:1.0:1787782920.295786:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787782920.295793:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b637070 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782920.295801:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f295800 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:1.0:1787782920.295804:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b637070 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787782920.295805:0:13080:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8c311841cd28) has no exports 00010000:00010000:1.0:1787782920.295820:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d98ed19b637070 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782920.295827:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d98ed19b637070 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782920.295833:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787782920.295836:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787782920.295838:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787782920.295850:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c3132181000 00010000:00010000:1.0:1787782920.295853:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d98ed19b637070 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782920.295861:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c312f295800/0x6d98ed19b637069 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d98ed19b637070 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782920.295875:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782920.295878:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b6372a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782920.295884:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6e00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:1.0:1787782920.295886:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b6372a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782920.295893:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d98ed19b6372a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787782920.295900:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d98ed19b6372a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782920.295915:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787782920.295918:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787782920.295919:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787782920.295927:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c3132181000 00010000:00010000:1.0:1787782920.295930:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d98ed19b6372a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782920.295935:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6e00/0x6d98ed19b6372a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d98ed19b6372a7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782920.295956:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782920.295958:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782920.295960:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782920.296090:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787782920.301603:0:13080:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c31347e17e0 - data ffff8c310f5390d8/ffff8c312efef800 00000020:01000000:2.0:1787782920.301782:0:13080:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c3129c53d80 - data ffff8c310f733288/ffff8c3001f89000 00100000:10000000:2.0:1787782920.315057:0:13080:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787782920.376205:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636e78 00000020:00000080:3.0:1787782920.376217:0:13080:0:(genops.c:885:class_export_put()) final put ffff8c313e592800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787782920.376239:0:13080:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c3129b5d800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787782920.376243:0:13080:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c3129b5d800 2 00000020:01000004:3.0:1787782920.376247:0:13080:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c3129b5d800 from lustre-OST0000 00000020:00000080:3.0:1787782920.376280:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782920.376360:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787782920.376364:0:13080:0:(genops.c:885:class_export_put()) final put ffff8c313e590000/lustre-OST0000_UUID 00000020:00000080:3.0:1787782920.376367:0:13080:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313e590000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787782920.376374:0:13080:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787782920.376441:0:13080:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787782920.376446:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787782920.376450:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782920.376456:0:13080:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00000080:1.0:1787782920.376502:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313e592800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:3.0:1787782920.376582:0:13080:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8c313c7cc000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787782920.376589:0:13080:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8c31082999b8) has exports, disconnecting them 00000020:00080000:3.0:1787782920.376594:0:13080:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8c313c7cc000), last request at 1787782679 00000020:00000080:3.0:1787782920.376598:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636ea2 00000020:00080000:3.0:1787782920.376609:0:13080:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c313c7cc000): rc 0 00000020:00000080:3.0:1787782920.376614:0:13080:0:(genops.c:885:class_export_put()) final put ffff8c313c7cc000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787782920.376689:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313c7cc000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787782920.378753:0:13080:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787782920.378838:0:13080:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782920.378842:0:13080:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787782920.378853:0:13080:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787782920.379021:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782920.379030:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787782920.379038:0:13080:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c3129b5d800 1 00000020:00000080:0.0:1787782920.379045:0:13080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636e32 00000020:00000080:0.0:1787782920.379054:0:13080:0:(genops.c:885:class_export_put()) final put ffff8c313c7ce800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787782920.379059:0:13080:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787782920.379064:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782920.379068:0:13080:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787782920.379072:0:13080:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8c313cd619b8) has no exports 00000020:00000080:1.0:1787782920.379114:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c312e5e8000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787782920.379122:0:37:0:(genops.c:885:class_export_put()) final put ffff8c30017d8800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787782920.379125:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c30017d8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787782920.379131:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787782920.379189:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313c7ce800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787782920.422178:0:13080:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787782920.422194:0:13080:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787782920.422200:0:13080:0:(genops.c:885:class_export_put()) final put ffff8c3129b5c800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787782920.422204:0:13080:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3129b5c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787782920.422213:0:13080:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787782920.422340:0:13080:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c3129b5f000 00000020:02000400:0.0:1787782920.422388:0:13080:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787782920.638066:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782921.634463:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782922.659228:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782923.681719:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787782923.755141:0:13232:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787782923.763384:0:13232:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787782923.766620:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637046 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782923.766643:0:13232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b637046 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782923.766651:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b637046 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782923.766658:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b637046 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782923.766683:0:13232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787782923.766688:0:13232:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787782923.766720:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787782923.766731:0:13232:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c31346fe1c0 x1874625922425600/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782925 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782923.766752:0:13232:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c31411d1a40 x1874625922426112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782930 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782923.766764:0:13232:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c31411d21c0 x1874625922426240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782931 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782923.766777:0:13232:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c31411d2580 x1874625922426496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782936 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782923.766783:0:13232:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787782923.766789:0:13232:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787782923.766814:0:13232:0:(import.c:65:import_set_state_nolock()) ffff8c313438c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787782923.766994:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782923.767003:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b637046 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782923.767032:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f295400 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:0.0:1787782923.767035:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b637046 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782923.767045:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d98ed19b637046 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782923.767053:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d98ed19b637046 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782923.767059:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787782923.767062:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787782923.767064:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787782923.767077:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c3132181000 00010000:00010000:0.0:1787782923.767081:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d98ed19b637046 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782923.767088:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c312f295400/0x6d98ed19b63703f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d98ed19b637046 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782923.767121:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782923.767123:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782923.767125:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782923.767142:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625922426624:0@lo:39:umount.0 00000400:00000100:0.0:1787782923.767195:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874625922426624 offset 0 length 224: 4 00000100:00100000:0.0:1787782923.768189:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922426496:0@lo:400:kworker.0 00000100:00100000:0.0:1787782923.768201:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922425600:0@lo:400:kworker.0 00000100:00100000:2.0:1787782923.768310:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922426240:0@lo:400:kworker.0 00000100:00100000:0.0:1787782923.773038:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874625922426112:0@lo:400:kworker.0 00010000:00010000:0.0:1787782924.705710:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787782925.409453:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) db359560-8e1a-42c0-a155-5e020d83d9a3->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787782925.409470:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) db359560-8e1a-42c0-a155-5e020d83d9a3->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787782925.735974:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782926.754858:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782927.777321:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782928.806253:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782929.828187:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787782930.529286:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) db359560-8e1a-42c0-a155-5e020d83d9a3->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787782930.529305:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) db359560-8e1a-42c0-a155-5e020d83d9a3->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787782930.849396:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782931.882949:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782932.897566:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782933.921646:0:6712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782933.986715:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782923/real 1787782923] req@ffff8c31346fde00 x1874625922426624/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787782933 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782933.986774:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c31346fde00 x1874625922426624/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787782933 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787782933.986795:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c313438c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787782933.986820:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625922426624:0@lo:39:umount.0 00000100:00080000:0.0:1787782933.988397:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787782933.988406:0:13232:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787782933.988413:0:13232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787782933.989646:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637054 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782933.989664:0:13232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b637054 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782933.989672:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b637054 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782933.989680:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b637054 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782933.989715:0:13232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787782933.989814:0:13232:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b637299 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782933.989842:0:13232:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b637299 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782933.989849:0:13232:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b637299 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782933.989856:0:13232:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x6d98ed19b637299 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782933.989879:0:13232:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787782933.989884:0:13232:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787782933.989906:0:13232:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787782933.989910:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787782933.989915:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787782933.989922:0:13232:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787782933.989927:0:13232:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8c3118418000) has no exports 00010000:00010000:3.0:1787782933.989949:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:0.0:1787782933.989956:0:13232:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8c3118418000) has no exports 00010000:00010000:3.0:1787782933.989961:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b637054 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782933.989972:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312f295000 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782933.989977:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b637054 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782933.989988:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d98ed19b637054 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782933.989997:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d98ed19b637054 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782933.990004:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787782933.990015:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787782933.990018:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787782933.990035:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c3132181000 00010000:00010000:3.0:1787782933.990039:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d98ed19b637054 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782933.990046:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c312f295000/0x6d98ed19b63704d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d98ed19b637054 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782933.990062:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782933.990077:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b637299 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782933.990083:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6000 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782933.990086:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x6d98ed19b637299 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782933.990152:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d98ed19b637299 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782933.990170:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d98ed19b637299 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782933.990176:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787782933.990178:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787782933.990180:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787782933.990186:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c3132181000 00010000:00010000:3.0:1787782933.990189:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d98ed19b637299 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782933.990196:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3140cc6000/0x6d98ed19b637292 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d98ed19b637299 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782933.990217:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782933.990219:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782933.990221:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782933.990363:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787782933.997785:0:13232:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c3134320000 - data ffff8c30034345e8/ffff8c312f3c6800 00000020:01000000:0.0:1787782933.997924:0:13232:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c313cd1bd80 - data ffff8c310f73e000/ffff8c312f3c0400 00100000:10000000:2.0:1787782934.025988:0:13232:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787782934.059533:0:13232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636f43 00000020:00000080:3.0:1787782934.059544:0:13232:0:(genops.c:885:class_export_put()) final put ffff8c313e592000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1787782934.059605:0:13232:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c310712b000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1787782934.059609:0:13232:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c310712b000 2 00000020:01000004:3.0:1787782934.059613:0:13232:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c310712b000 from lustre-OST0001 00000020:00000080:3.0:1787782934.059638:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782934.059650:0:13232:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1787782934.059654:0:13232:0:(genops.c:885:class_export_put()) final put ffff8c31061ec000/lustre-OST0001_UUID 00000020:00000080:3.0:1787782934.059657:0:13232:0:(genops.c:844:class_export_destroy()) destroying export ffff8c31061ec000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1787782934.059665:0:13232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1787782934.059835:0:13232:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import db359560-8e1a-42c0-a155-5e020d83d9a3->MGS 00010000:00010000:3.0:1787782934.059850:0:13232:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31421fc000/0x6d98ed19b636e55 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d98ed19b636e5c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782934.059927:0:13232:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31421fc000/0x6d98ed19b636e55 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d98ed19b636e5c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782934.059934:0:13232:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1787782934.059937:0:13232:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1787782934.059941:0:13232:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1787782934.059983:0:13232:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c3132181000 00010000:00010000:3.0:1787782934.059988:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31421fc000/0x6d98ed19b636e55 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d98ed19b636e5c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782934.060005:0:13232:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b637093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x6d98ed19b63709a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782934.060027:0:13232:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b637093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x6d98ed19b63709a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782934.060033:0:13232:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787782934.060035:0:13232:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1787782934.060037:0:13232:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1787782934.060049:0:13232:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c3132181000 00010000:00010000:3.0:1787782934.060052:0:13232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b637093 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x6d98ed19b63709a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787782934.060069:0:13232:0:(import.c:65:import_set_state_nolock()) ffff8c3132181000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1787782934.060073:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1787782934.060075:0:13232:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1787782934.060077:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1787782934.060081:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1787782934.060091:0:13232:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c31411d0780 x1874625922426368/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787782935 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787782934.060136:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787782934.060140:0:13232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:3.0:1787782934.060401:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:db359560-8e1a-42c0-a155-5e020d83d9a3:3303:1874625922426368:0@lo:250:kworker.0 10000000:01000000:3.0:1787782934.060428:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787782934.060434:0:13232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636d36 00000020:00000080:3.0:1787782934.060439:0:13232:0:(genops.c:885:class_export_put()) final put ffff8c3132181800/db359560-8e1a-42c0-a155-5e020d83d9a3 00000020:00000080:1.0:1787782934.063660:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313e592000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787782934.064631:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.115@tcp (flags='') 00000020:00000080:3.0:1787782934.064641:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782934.064649:0:13232:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.115@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787782934.064654:0:13232:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8c31091e8000) has no exports 00000020:00000080:1.0:1787782934.064729:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3132181800/db359560-8e1a-42c0-a155-5e020d83d9a3 for MGC192.168.202.115@tcp 10000000:01000000:2.0:1787782934.065667:0:5848:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787782934.065833:0:13232:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.115@tcp: client import never connected 00000100:00080000:3.0:1787782934.065838:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787782934.065853:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787782934.065856:0:13232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787782934.065868:0:13232:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787782934.065970:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782934.065978:0:13232:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.115@tcp (uuid db359560-8e1a-42c0-a155-5e020d83d9a3) 00000020:01000000:3.0:1787782934.065985:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787782934.065989:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782934.065994:0:13232:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787782934.066002:0:13232:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8c313438e800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787782934.066008:0:13232:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8c3134384d28) has exports, disconnecting them 00000020:00080000:3.0:1787782934.066012:0:13232:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8c313438e800), last request at 1787782698 00000020:00000080:3.0:1787782934.066018:0:13232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636f6d 00000020:00080000:3.0:1787782934.066034:0:13232:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c313438e800): rc 0 00000020:00000080:3.0:1787782934.066038:0:13232:0:(genops.c:885:class_export_put()) final put ffff8c313438e800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787782934.066564:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c3132181000 for MGC192.168.202.115@tcp 00000020:00000080:1.0:1787782934.066583:0:37:0:(genops.c:885:class_export_put()) final put ffff8c3132183800/db359560-8e1a-42c0-a155-5e020d83d9a3 00000020:00000080:1.0:1787782934.066586:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3132183800/db359560-8e1a-42c0-a155-5e020d83d9a3 for MGC192.168.202.115@tcp 00000020:01000000:1.0:1787782934.066596:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.115@tcp (db359560-8e1a-42c0-a155-5e020d83d9a3) 00000020:00000080:1.0:1787782934.068916:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313438e800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787782934.069511:0:13232:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787782934.069516:0:13232:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787782934.069520:0:13232:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787782934.069526:0:13232:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787782934.069615:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c313438c000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1787782934.071166:0:6712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787782934.071518:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787782934.071625:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1787782934.072059:0:5834:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8c3107163e00:5834] 1 exiting: rc = 0 00000100:00100000:1.0:1787782934.072139:0:5833:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8c3107162c00:5833] 0 exiting: rc = 1 00000100:00100000:3.0:1787782934.072316:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782934.073743:0:5835:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8c3107162600:5835] 0 exiting: rc = 1 00000100:00100000:1.0:1787782934.073828:0:5836:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8c3107163400:5836] 1 exiting: rc = 0 00000100:00100000:3.0:1787782934.074077:0:5837:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8c3107162a00:5837] 2 exiting: rc = 0 00000100:00100000:3.0:1787782934.075245:0:7637:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8c313d604000:7637] 3 exiting: rc = 0 00000100:00100000:3.0:1787782934.075347:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075356:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075363:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075370:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075376:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075382:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075388:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075394:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075399:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075405:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075436:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075443:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075449:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075455:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075461:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075466:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075472:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075478:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075482:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075488:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075492:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075497:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075501:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075506:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075510:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075515:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075519:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075523:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075528:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075533:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075538:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075542:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075547:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075551:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075556:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075560:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075564:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075569:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075574:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075579:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075584:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075588:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075593:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075599:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075603:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075615:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075620:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075625:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075632:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075637:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075642:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075647:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075652:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075657:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075662:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075667:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075673:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075678:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075683:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075687:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075692:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075697:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075702:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.075708:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787782934.080649:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782934.080662:0:13232:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787782934.080669:0:13232:0:(genops.c:885:class_export_put()) final put ffff8c3133fde000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787782934.080674:0:13232:0:(genops.c:844:class_export_destroy()) destroying export ffff8c3133fde000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787782934.080685:0:13232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787782934.080740:0:13232:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c310712b000 1 00000020:00000080:3.0:1787782934.080746:0:13232:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x6d98ed19b636f12 00000020:00000080:3.0:1787782934.080752:0:13232:0:(genops.c:885:class_export_put()) final put ffff8c310905d800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787782934.080767:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787782934.080771:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782934.080775:0:13232:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787782934.080779:0:13232:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8c31068d3370) has no exports 00000020:00000080:1.0:1787782934.081571:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c310905d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787782934.099582:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782934.099596:0:13232:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787782934.099601:0:13232:0:(genops.c:885:class_export_put()) final put ffff8c310712c800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787782934.099614:0:13232:0:(genops.c:844:class_export_destroy()) destroying export ffff8c310712c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787782934.099621:0:13232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787782934.099805:0:13232:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c310712d800 00000020:01000000:3.0:1787782934.099827:0:13232:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787782934.099831:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787782934.099835:0:13232:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787782934.099839:0:13232:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8c3108298000) has no exports 00000020:00000080:3.0:1787782934.099870:0:13232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787782934.099876:0:13232:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787782934.099878:0:13232:0:(genops.c:885:class_export_put()) final put ffff8c313c7ce000/OSS_uuid 00000020:00000080:3.0:1787782934.099881:0:13232:0:(genops.c:844:class_export_destroy()) destroying export ffff8c313c7ce000/OSS_uuid for OSS 00000020:01000000:3.0:1787782934.099885:0:13232:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1787782934.101028:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8c313c74d600:6698] 2 exiting: rc = 0 00000100:00100000:3.0:1787782934.101152:0:6967:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8c3137e2ba00:6967] 3 exiting: rc = 0 00000100:00080000:3.0:1787782934.101201:0:5847:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787782934.104193:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8c3133fe1200:6697] 1 exiting: rc = 0 00000100:00100000:1.0:1787782934.108679:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8c3140eb3e00:6696] 0 exiting: rc = 1 00000100:00100000:3.0:1787782934.109552:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109563:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109570:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109576:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109581:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109587:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109592:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109597:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109602:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109608:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109613:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109618:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109622:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109627:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109632:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109637:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109642:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109649:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109665:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109670:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109676:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109681:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109686:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109691:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109696:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109701:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109706:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109831:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109837:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109842:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109847:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109852:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109918:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109928:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109933:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109937:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109942:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109948:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109953:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109958:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109963:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109968:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109974:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109979:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109984:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109990:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109994:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.109999:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.110004:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.110011:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.110016:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.110021:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.110025:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.110040:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.110045:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.110050:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.110055:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.110060:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.110327:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.110344:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.110354:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.110360:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.110365:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.110371:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.114205:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8c310527e000:6700] 0 exiting: rc = 1 00000100:00100000:1.0:1787782934.115085:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8c3129a5c600:6701] 1 exiting: rc = 0 00000100:00100000:1.0:1787782934.116185:0:8475:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8c3134544c00:8475] 2 exiting: rc = 0 00000100:00100000:3.0:1787782934.116445:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116454:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116460:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116465:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116470:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116475:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116479:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116483:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116488:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116493:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116498:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116502:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116507:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116511:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116516:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116521:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116526:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116531:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116536:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116541:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116546:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116551:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116556:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116574:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116579:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116584:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116589:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116594:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116598:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116603:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116608:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116612:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116617:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116622:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116627:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116631:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116636:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116640:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116645:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116650:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116654:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116659:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116663:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116668:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116672:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116677:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116682:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116687:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116693:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116698:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116703:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116718:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116724:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116730:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116735:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116740:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116744:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116749:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116762:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116766:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116771:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116776:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116780:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.116784:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782934.118396:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8c313c74c400:6703] 1 exiting: rc = 0 00000100:00100000:2.0:1787782934.118648:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8c313c74da00:6702] 0 exiting: rc = 1 00000100:00100000:3.0:1787782934.119014:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8c313c74c800:6704] 2 exiting: rc = 0 00000100:00100000:3.0:1787782934.119082:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119503:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119512:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119518:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119524:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119530:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119535:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119540:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119546:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119551:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119557:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119563:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119568:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119574:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119579:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119585:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119590:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119595:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119600:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119605:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119610:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119614:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119619:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119624:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119630:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119635:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119874:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119882:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119897:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119902:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119908:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119914:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119919:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119924:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119930:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119935:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119941:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119946:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119952:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119958:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119963:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119969:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119975:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119980:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119985:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119991:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.119996:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120001:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120008:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120014:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120035:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120042:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120047:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120053:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120058:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120405:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120414:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120420:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120426:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120431:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120437:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120443:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120449:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.120463:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787782934.127459:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8c31298f6600:6706] 1 exiting: rc = 0 00000100:00100000:1.0:1787782934.130795:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8c31298f6000:6705] 0 exiting: rc = 1 00000100:00100000:3.0:1787782934.131414:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131467:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131474:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131505:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131512:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131518:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131524:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131529:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131534:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131539:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131544:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131550:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131557:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131562:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131569:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131574:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131578:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131583:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131589:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131595:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131627:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131635:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131640:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131645:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131651:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131681:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131689:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131694:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131699:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131704:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131710:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131801:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131806:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131811:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131828:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131837:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131843:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131959:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131967:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131972:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131978:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131983:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131988:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131993:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.131997:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132002:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132007:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132012:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132017:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132022:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132028:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132032:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132037:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132042:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132047:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132051:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132057:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132063:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132354:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132359:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132365:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132371:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132377:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.132382:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787782934.133792:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8c3106856600:6708] 1 exiting: rc = 0 00000100:00100000:2.0:1787782934.134754:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8c31070c8200:6707] 0 exiting: rc = 1 00000100:00100000:3.0:1787782934.134954:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.134965:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.134972:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.134977:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.134982:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135001:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135008:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135014:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135020:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135025:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135042:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135049:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135055:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135060:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135079:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135086:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135091:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135947:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135959:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135965:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135972:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135978:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.135999:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136005:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136012:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136020:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136027:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136033:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136039:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136051:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136382:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136390:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136396:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136402:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136427:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136433:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136438:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136444:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136450:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136456:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136473:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136479:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136517:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136523:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136529:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136535:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136557:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136563:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136569:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136575:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136581:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136587:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136594:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136601:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136609:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136616:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136622:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136628:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136677:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136684:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136692:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136697:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136814:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787782934.136830:0:13232:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787782934.144736:0:13232:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787782952.142086:0:13851:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787782960.501004:0:14312:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787782960.501008:0:14312:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787782960.501150:0:14312:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c3129e3b800 00000020:01000004:2.0:1787782960.501165:0:14312:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787782960.501172:0:14312:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787782960.501186:0:14312:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8c3134380000) 00000020:00000080:2.0:1787782960.501198:0:14312:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787782960.525811:0:14312:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787782960.530755:0:14312:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1787782960.531224:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:3.0:1787782960.531324:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:3.0:1787782960.531625:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:3.0:1787782960.531816:0:14312:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787782960.531888:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:3.0:1787782960.531985:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:3.0:1787782960.532297:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:3.0:1787782960.532649:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:3.0:1787782960.533832:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 640: rc = 0 00100000:10000000:3.0:1787782960.533926:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 640: rc = 0 00100000:10000000:3.0:1787782960.534839:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 562: rc = 0 00100000:10000000:3.0:1787782960.535829:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 562: rc = 0 00100000:10000000:3.0:1787782960.536254:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 562: rc = 0 00100000:10000000:3.0:1787782960.536678:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 562: rc = 0 00100000:10000000:3.0:1787782960.536966:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 562: rc = 0 00100000:10000000:3.0:1787782960.537322:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 562: rc = 0 00100000:10000000:3.0:1787782960.537741:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 562: rc = 0 00100000:10000000:3.0:1787782960.537963:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 562: rc = 0 00100000:10000000:3.0:1787782960.538675:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 562: rc = 0 00100000:10000000:3.0:1787782960.538952:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 562: rc = 0 00100000:10000000:3.0:1787782960.539314:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 562: rc = 0 00100000:10000000:3.0:1787782960.539781:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 562: rc = 0 00100000:10000000:3.0:1787782960.540688:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 235: rc = 0 00100000:10000000:3.0:1787782960.540948:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 235: rc = 0 00100000:10000000:3.0:1787782960.541302:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 235: rc = 0 00100000:10000000:3.0:1787782960.541765:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 235: rc = 0 00100000:10000000:3.0:1787782960.542005:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 235: rc = 0 00100000:10000000:3.0:1787782960.542572:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 235: rc = 0 00100000:10000000:3.0:1787782960.542818:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 235: rc = 0 00100000:10000000:3.0:1787782960.543179:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 235: rc = 0 00100000:10000000:3.0:1787782960.543548:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 235: rc = 0 00100000:10000000:3.0:1787782960.543805:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 235: rc = 0 00100000:10000000:3.0:1787782960.544217:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 235: rc = 0 00100000:10000000:3.0:1787782960.544589:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 235: rc = 0 00100000:10000000:3.0:1787782960.544832:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 235: rc = 0 00100000:10000000:3.0:1787782960.545199:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 235: rc = 0 00100000:10000000:3.0:1787782960.545681:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 235: rc = 0 00100000:10000000:3.0:1787782960.545926:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 235: rc = 0 00100000:10000000:3.0:1787782960.546343:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 235: rc = 0 00100000:10000000:3.0:1787782960.546774:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 235: rc = 0 00100000:10000000:3.0:1787782960.547015:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 235: rc = 0 00100000:10000000:3.0:1787782960.547589:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 235: rc = 0 00100000:10000000:3.0:1787782960.547833:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 235: rc = 0 00100000:10000000:0.0:1787782960.548969:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 235: rc = 0 00100000:10000000:0.0:1787782960.549335:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 235: rc = 0 00100000:10000000:0.0:1787782960.549638:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 235: rc = 0 00100000:10000000:0.0:1787782960.549880:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 235: rc = 0 00100000:10000000:0.0:1787782960.550383:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 235: rc = 0 00100000:10000000:0.0:1787782960.550627:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 235: rc = 0 00100000:10000000:0.0:1787782960.550874:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 235: rc = 0 00100000:10000000:0.0:1787782960.551295:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 235: rc = 0 00100000:10000000:0.0:1787782960.551605:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 235: rc = 0 00100000:10000000:0.0:1787782960.551840:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 235: rc = 0 00100000:10000000:0.0:1787782960.552418:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 235: rc = 0 00100000:10000000:0.0:1787782960.552780:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 646: rc = 0 00100000:10000000:0.0:1787782960.553428:0:14312:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1787782960.553591:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:0.0:1787782960.553789:0:14312:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1787782960.553855:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:0.0:1787782960.554216:0:14312:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1787782960.554287:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:0.0:1787782960.554671:0:14312:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1787782960.554748:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 213: rc = 0 00100000:10000000:0.0:1787782960.554928:0:14312:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1787782960.554993:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 213: rc = 0 00100000:10000000:0.0:1787782960.555385:0:14312:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1787782960.555453:0:14312:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 213: rc = 0 00000020:00000080:0.0:1787782960.555706:0:14312:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787782960.555714:0:14312:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787782960.555726:0:14312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d98ed19b638037 00000020:01000004:0.0:1787782960.555734:0:14312:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787782960.555739:0:14312:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787782960.555746:0:14312:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c3129e3b800 from MGS 00000020:01000004:0.0:1787782960.555750:0:14312:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787782960.555760:0:14312:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8c3118418000) 00000020:00000080:0.0:1787782960.555769:0:14312:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787782960.555816:0:14312:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c3129e3b800 from MGS, refs=2 00080000:01000000:0.0:1787782960.555820:0:14312:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787782960.555825:0:14312:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d98ed19b638045 00000100:00100000:0.0:1787782960.555910:0:14312:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787782960.557385:0:14312:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787782960.557398:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787782960.557881:0:14312:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787782960.557888:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787782960.558629:0:14312:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787782960.558794:0:14312:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787782960.558799:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787782960.559469:0:14312:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787782960.559477:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787782960.559785:0:14312:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787782960.559791:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787782960.560516:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782960.560519:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782960.560521:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782960.560787:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782960.560789:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782960.560790:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782960.561467:0:14312:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787782960.565274:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787782960.573523:0:14312:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787782960.573541:0:14312:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787782960.573543:0:14312:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787782960.575245:0:14321:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787782960.575392:0:14312:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787782960.575487:0:14312:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787782960.575934:0:14312:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787782960.578684:0:14312:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787782960.578874:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787782960.578881:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787782960.584513:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787782960.584525:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787782960.584925:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787782960.584931:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787782960.585769:0:14312:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787782960.585792:0:14312:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.115@tcp' 00000020:01000004:2.0:1787782960.585794:0:14312:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787782960.585823:0:14312:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.115@tcp (typ=mgc) 00000020:00000080:2.0:1787782960.585837:0:14312:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.115@tcp (ffff8c31343819b8) 00000020:00000080:2.0:1787782960.585854:0:14312:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787782960.585930:0:14312:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c3129e39000@MGC192.168.202.115@tcp: add connection 192.168.202.115@tcp at head 00010000:00010000:2.0:1787782960.586346:0:14312:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.115@tcp-0 is initialized 00000040:01000000:2.0:1787782960.586353:0:14312:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787782960.586691:0:14326:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787782960.586799:0:14327:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787782960.586862:0:14312:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.115@tcp (uuid 48c63e6d-1dfe-4772-affc-638938210ba4) 00000020:00000080:1.0:1787782960.586887:0:14312:0:(genops.c:1385:class_connect()) connect: client 48c63e6d-1dfe-4772-affc-638938210ba4, cookie 0x6d98ed19b638053 00000100:00080000:1.0:1787782960.586898:0:14312:0:(import.c:510:import_select_connection()) MGC192.168.202.115@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787782960.586905:0:14312:0:(import.c:624:import_select_connection()) MGC192.168.202.115@tcp: import ffff8c3129e39000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787782960.586939:0:14312:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c31411d0000 x1874625922426752/t0(0) o250->MGC192.168.202.115@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787782960.586966:0:14312:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 48c63e6d-1dfe-4772-affc-638938210ba4->MGS 00000020:01000004:1.0:1787782960.586989:0:14312:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787782960.586993:0:14312:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787782960.587005:0:14312:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8c31068d0000) 00000020:00000080:1.0:1787782960.587015:0:14312:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787782960.587289:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:48c63e6d-1dfe-4772-affc-638938210ba4:3303:1874625922426752:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787782960.587360:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782960.587470:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922426752 00000100:00100000:2.0:1787782960.587477:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922426752 00000100:00100000:2.0:1787782960.587512:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782960.587519:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1874625922426752:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1787782960.587541:0:14323:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 48c63e6d-1dfe-4772-affc-638938210ba4@0@lo t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:2.0:1787782960.587561:0:14323:0:(genops.c:1385:class_connect()) connect: client 48c63e6d-1dfe-4772-affc-638938210ba4, cookie 0x6d98ed19b638061 00000100:00080000:2.0:1787782960.587676:0:14323:0:(import.c:65:import_set_state_nolock()) ffff8c3129e3c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782960.587732:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+5:3303:x1874625922426752:12345-0@lo:250:mount.lustre.0 Request processed in 211us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782960.587740:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782960.587782:0:3303:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.115@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787782960.587790:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.115@tcp: connect to target with instance 0 00000100:00080000:2.0:1787782960.587797:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.115@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787782960.587801:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787782960.587804:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c3129e39000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787782960.587807:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787782960.587814:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787782960.587819:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:48c63e6d-1dfe-4772-affc-638938210ba4:3303:1874625922426752:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787782960.606530:0:14312:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787782960.606745:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787782960.606752:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787782960.609764:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787782960.609775:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787782960.610342:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787782960.610349:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787782960.611317:0:14312:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782960.611497:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787782960.611503:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787782960.611917:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787782960.611928:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787782960.641956:0:14312:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787782960.642445:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787782960.642451:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787782960.643711:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787782960.643719:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787782960.644421:0:14312:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787782960.644564:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787782960.644569:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787782960.645258:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787782960.645270:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787782960.645732:0:14312:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787782960.645869:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787782960.645873:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787782960.646373:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787782960.646379:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787782960.646875:0:14312:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787782960.647013:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787782960.647017:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787782960.647528:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787782960.647534:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787782960.670215:0:14312:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782960.670510:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787782960.670517:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787782960.671963:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787782960.671976:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787782960.672870:0:14312:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787782960.672880:0:14312:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787782960.674496:0:14312:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787782960.674525:0:14312:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787782960.674531:0:14312:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787782960.674664:0:14312:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787782960.674705:0:14312:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.115@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787782960.674710:0:14312:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787782960.674711:0:14312:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787782960.674713:0:14312:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782960.674714:0:14312:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782960.674715:0:14312:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782960.674716:0:14312:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782960.674718:0:14312:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787782960.674720:0:14312:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787782960.674722:0:14312:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782960.674723:0:14312:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787782960.674726:0:14312:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787782960.674728:0:14312:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787782960.674729:0:14312:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787782960.674730:0:14312:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782960.674731:0:14312:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782960.674732:0:14312:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782960.674733:0:14312:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782960.674734:0:14312:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787782960.674736:0:14312:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787782960.674737:0:14312:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782960.674738:0:14312:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787782960.674779:0:14312:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787782960.674800:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922426880:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787782960.674881:0:14312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782960.674986:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312f2e4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787782960.675240:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922426880 00000100:00100000:1.0:1787782960.675247:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922426880 00000100:00100000:1.0:1787782960.675328:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787782960.675337:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c801c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+5:14312:x1874625922426880:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787782960.675485:0:14325:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787782960.675489:0:14325:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787782960.675492:0:14325:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787782960.675859:0:14346:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787782960.676317:0:14325:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1787782960.677676:0:14347:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787782960.677682:0:14347:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787782960.677684:0:14347:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787782960.677717:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1787782960.677994:0:14325:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787782960.678006:0:14325:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787782960.685652:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c801c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+5:14312:x1874625922426880:12345-0@lo:253:mount.lustre.0 Request processed in 10307us (10761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782960.685667:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787782960.685752:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922426880:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787782960.685768:0:14312:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787782960.685771:0:14312:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787782960.685773:0:14312:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787782960.685775:0:14312:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782960.685776:0:14312:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782960.685777:0:14312:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782960.685778:0:14312:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782960.685780:0:14312:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787782960.685781:0:14312:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787782960.685783:0:14312:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782960.685785:0:14312:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787782960.685806:0:14312:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c3129e3b800 from lustre-MDT0000 10000000:01000000:2.0:1787782960.685830:0:14312:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787782960.685833:0:14312:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787782960.685837:0:14312:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c31343819b8 10000000:01000000:2.0:1787782960.685841:0:14312:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787782960.685849:0:14312:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c31343819b8 from 1 10000000:01000000:2.0:1787782960.685853:0:14312:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787782960.685892:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141205600/0x6d98ed19b638068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782960.685903:0:14312:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141205600/0x6d98ed19b638068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782960.685912:0:14312:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141205600/0x6d98ed19b638068 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782960.685950:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922427008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787782960.685987:0:14312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782960.686160:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312f2e4900 going to sleep for 11 seconds 00000100:00100000:3.0:1787782960.686340:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922427008 00000100:00100000:3.0:1787782960.686357:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922427008 00000100:00100000:3.0:1787782960.686401:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787782960.686409:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+5:14312:x1874625922427008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782960.686422:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782960.686437:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31013a0800/0x6d98ed19b63806f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b638068 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.686460:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a0800/0x6d98ed19b63806f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b638068 expref: 6 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.686470:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31013a0800/0x6d98ed19b63806f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b638068 expref: 6 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.686480:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0800, rc 0) 00000100:00100000:3.0:1787782960.686562:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+6:14312:x1874625922427008:12345-0@lo:101:mount.lustre.0 Request processed in 154us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782960.686569:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782960.686709:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fde00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922427008:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782960.686725:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141205600/0x6d98ed19b638068 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63806f expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.686735:0:14312:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141205600/0x6d98ed19b638068 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b63806f expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782960.686781:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922427136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782960.686807:0:14312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782960.686859:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d0c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782960.686914:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922427136 00000100:00100000:1.0:1787782960.686918:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922427136 00000100:00100000:1.0:1787782960.686944:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787782960.686950:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+6:14312:x1874625922427136:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782960.687340:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+6:14312:x1874625922427136:12345-0@lo:501:mount.lustre.0 Request processed in 389us (531us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787782960.687436:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922427136:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787782960.687463:0:14312:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787782960.687476:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141205600/0x6d98ed19b638068 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63806f expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.687484:0:14312:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141205600/0x6d98ed19b638068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63806f expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782960.687503:0:14312:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c3129e3b800 10000000:01000000:0.0:1787782960.687508:0:14312:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787782960.687512:0:14312:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c3129e3b800 10000000:01000000:0.0:1787782960.687517:0:14312:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787782960.687519:0:14312:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8c3129e3b800 from 1 10000000:01000000:0.0:1787782960.687522:0:14312:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787782960.687541:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255600/0x6d98ed19b638076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.687549:0:14312:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141255600/0x6d98ed19b638076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.687557:0:14312:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141255600/0x6d98ed19b638076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782960.687570:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922427264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787782960.687596:0:14312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782960.687616:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d0c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782960.687662:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787782960.687684:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922427264 00000100:00100000:1.0:1787782960.687687:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922427264 00000100:00100000:1.0:1787782960.687703:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787782960.687708:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c803450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+6:14312:x1874625922427264:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782960.687716:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782960.687727:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3140cc6200/0x6d98ed19b63807d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b638076 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.687741:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3140cc6200/0x6d98ed19b63807d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b638076 expref: 7 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.687750:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3140cc6200/0x6d98ed19b63807d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b638076 expref: 7 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.687758:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6200, rc 0) 00000100:00100000:1.0:1787782960.687789:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c803450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+7:14312:x1874625922427264:12345-0@lo:101:mount.lustre.0 Request processed in 80us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782960.687795:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787782960.687863:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922427264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782960.687873:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141255600/0x6d98ed19b638076 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63807d expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.687881:0:14312:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141255600/0x6d98ed19b638076 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b63807d expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782960.687893:0:14312:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787782960.687896:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255600/0x6d98ed19b638076 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63807d expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.687908:0:14312:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141255600/0x6d98ed19b638076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63807d expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782960.687914:0:14312:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787782960.687917:0:14312:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787782960.687921:0:14312:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c3129e3b800 10000000:01000000:0.0:1787782960.687923:0:14312:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787782960.687925:0:14312:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787782960.687927:0:14312:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787782960.687940:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255800/0x6d98ed19b638084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.687947:0:14312:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141255800/0x6d98ed19b638084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.687953:0:14312:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141255800/0x6d98ed19b638084 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782960.687963:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922427392:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787782960.687985:0:14312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782960.688002:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d0c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787782960.688165:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922427392 00000100:00100000:1.0:1787782960.688169:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922427392 00000100:00100000:1.0:1787782960.688230:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787782960.688237:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+7:14312:x1874625922427392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782960.688244:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782960.688252:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3140cc6600/0x6d98ed19b63808b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b638084 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.688278:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3140cc6600/0x6d98ed19b63808b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b638084 expref: 8 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.688287:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3140cc6600/0x6d98ed19b63808b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b638084 expref: 8 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.688294:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6600, rc 0) 00000100:00100000:1.0:1787782960.688321:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+8:14312:x1874625922427392:12345-0@lo:101:mount.lustre.0 Request processed in 85us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782960.688327:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787782960.688541:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922427392:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782960.688551:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141255800/0x6d98ed19b638084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63808b expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.688559:0:14312:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141255800/0x6d98ed19b638084 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b63808b expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782960.688609:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922427520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782960.688631:0:14312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782960.688658:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d0c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782960.688702:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922427520 00000100:00100000:2.0:1787782960.688706:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922427520 00000100:00100000:2.0:1787782960.688728:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787782960.688734:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c801050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+8:14312:x1874625922427520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782960.689494:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c801050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+9:14312:x1874625922427520:12345-0@lo:501:mount.lustre.0 Request processed in 758us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782960.689507:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787782960.689574:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922427520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782960.689612:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922427648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782960.689654:0:14312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782960.689688:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312f2e4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787782960.689742:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922427648 00000100:00100000:1.0:1787782960.689748:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922427648 00000100:00100000:1.0:1787782960.689782:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787782960.689790:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+9:14312:x1874625922427648:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787782960.690226:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+9:14312:x1874625922427648:12345-0@lo:503:mount.lustre.0 Request processed in 436us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782960.690233:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787782960.690448:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922427648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782960.691176:0:14348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c63e6d-1dfe-4772-affc-638938210ba4:14348:1874625922427776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782960.691291:0:14348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782960.691422:0:14348:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312f2e40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787782960.691471:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922427776 00000100:00100000:0.0:1787782960.691476:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922427776 00000100:00100000:0.0:1787782960.691556:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787782960.691565:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+9:14348:x1874625922427776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787782960.691842:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+9:14348:x1874625922427776:12345-0@lo:502:llog_process_th.0 Request processed in 279us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782960.691850:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787782960.691923:0:14348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346ff480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c63e6d-1dfe-4772-affc-638938210ba4:14348:1874625922427776:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787782960.691947:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782960.691957:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782960.691959:0:14348:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787782960.691964:0:14348:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787782960.691967:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787782960.691979:0:14348:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8c313cd64d28) 00000020:00000080:3.0:1787782960.691996:0:14348:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787782960.692001:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787782960.692088:0:14348:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787782960.692125:0:14348:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d98ed19b638099 00000020:00000080:3.0:1787782960.692323:0:14348:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787782960.692328:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782960.692332:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782960.692334:0:14348:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787782960.692337:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782960.692340:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782960.692341:0:14348:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787782960.692541:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787782960.692552:0:14348:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8c313cd619b8) 00000020:00000080:3.0:1787782960.692563:0:14348:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787782960.692568:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787782960.692570:0:14348:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787782960.692573:0:14348:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787782960.692579:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787782960.692618:0:14348:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c3129e3b800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787782960.692630:0:14348:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8c313cd63370) 00000020:00000080:3.0:1787782960.692638:0:14348:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787782960.692696:0:14348:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787782960.692703:0:14348:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d98ed19b6380ae 00000020:00000080:3.0:1787782960.692792:0:14348:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787782960.692798:0:14348:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787782960.692808:0:14348:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6d98ed19b6380b5 00080000:01000000:3.0:1787782960.692814:0:14348:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787782960.692817:0:14348:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d98ed19b6380bc 00010000:00010000:2.0:1787782960.786019:0:14348:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787782960.786881:0:14348:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787782960.787072:0:14348:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787782960.787999:0:14348:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8c3134384d28) 00000020:00000080:2.0:1787782960.788014:0:14348:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787782960.788070:0:14348:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787782960.788078:0:14348:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d98ed19b6380ca 00000020:00000080:2.0:1787782960.789589:0:14348:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787782960.798163:0:14348:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6d98ed19b6380d1 00000020:00000080:3.0:1787782960.800456:0:14348:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787782960.800471:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782960.800480:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782960.800482:0:14348:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787782960.800485:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787782960.800488:0:14348:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1787782960.800490:0:14348:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787782960.800491:0:14348:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787782960.800493:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787782960.800495:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782960.800497:0:14348:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787782960.800499:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782960.800504:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782960.800505:0:14348:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787782960.800509:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787782960.800555:0:14348:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787782960.800567:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782960.800570:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782960.800571:0:14348:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787782960.800574:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787782960.800577:0:14348:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787782960.800580:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782960.800582:0:14348:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787782960.800584:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787782960.800589:0:14348:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.115@tcp to nid 0x20000c0a8ca73 (192.168.202.115@tcp) 00000020:01000000:3.0:1787782960.800614:0:14348:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787782960.800617:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787782960.800629:0:14348:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c313cd60000) 00000020:00000080:3.0:1787782960.800642:0:14348:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787782960.800645:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787782960.800703:0:14348:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787782960.800719:0:14348:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787782960.800724:0:14348:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d98ed19b6380df 00010000:00080000:3.0:1787782960.800757:0:14348:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c3132180000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:3.0:1787782960.800922:0:14348:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787782960.801347:0:14348:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787782960.801388:0:14348:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787782960.802031:0:14348:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787782960.802068:0:14348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787782960.802201:0:14348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787782960.804046:0:14352:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787782960.804053:0:14352:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787782960.804416:0:14348:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787782960.804426:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787782960.804455:0:14348:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787782960.804472:0:14348:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d98ed19b6380e6 00000100:00080000:1.0:1787782960.804482:0:14348:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787782960.804488:0:14348:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c3132180000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787782960.804526:0:14348:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c31411d1e00 x1874625922427904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787782960.804548:0:14348:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787782960.804600:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782960.804604:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782960.804606:0:14348:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787782960.804609:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787782960.804612:0:14348:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1787782960.804614:0:14348:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787782960.804615:0:14348:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787782960.804617:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787782960.804619:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782960.804621:0:14348:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787782960.804623:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787782960.804626:0:14348:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787782960.804629:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782960.804631:0:14348:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787782960.804633:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787782960.804635:0:14348:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.115@tcp to nid 0x20000c0a8ca73 (192.168.202.115@tcp) 00000020:01000000:1.0:1787782960.804653:0:14348:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787782960.804655:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787782960.804664:0:14348:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c31068d19b8) 00000020:00000080:1.0:1787782960.804672:0:14348:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787782960.804675:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787782960.804736:0:14348:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787782960.804742:0:14348:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787782960.804760:0:14348:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6d98ed19b6380f4 00010000:00080000:1.0:1787782960.804804:0:14348:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c3001e17000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:1.0:1787782960.804949:0:14348:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787782960.805085:0:14348:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787782960.805146:0:14348:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787782960.805767:0:14348:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782960.805830:0:14348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787782960.805882:0:14348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1787782960.806226:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922427904:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787782960.806282:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874625922427904 offset 0 length 520: 4 00000040:00080000:1.0:1787782960.813663:0:14354:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787782960.813671:0:14354:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787782960.818963:0:14348:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787782960.818983:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787782960.819048:0:14348:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787782960.819073:0:14348:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d98ed19b6380fb 00000100:00080000:3.0:1787782960.819085:0:14348:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787782960.819117:0:14348:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c3001e17000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:3.0:1787782960.819158:0:14348:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c313ccab840 x1874625922428032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787782960.819182:0:14348:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1787782960.819369:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922428032:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787782960.819430:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874625922428032 offset 0 length 520: 4 00000020:01000000:3.0:1787782960.819531:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782960.819537:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782960.819540:0:14348:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787782960.819542:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782960.819547:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782960.819549:0:14348:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787782960.819551:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787782960.819553:0:14348:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787782960.819556:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782960.819558:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782960.819559:0:14348:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787782960.819561:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782960.819580:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782960.819582:0:14348:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787782960.819586:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787782960.819617:0:14348:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccaa940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c63e6d-1dfe-4772-affc-638938210ba4:14348:1874625922428160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782960.819673:0:14348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782960.819702:0:14348:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31296360c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782960.819784:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922428160 00000100:00100000:2.0:1787782960.819792:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922428160 00000100:00100000:2.0:1787782960.819845:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787782960.819855:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+9:14348:x1874625922428160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782960.820199:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+9:14348:x1874625922428160:12345-0@lo:502:llog_process_th.0 Request processed in 345us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782960.820207:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787782960.820489:0:14348:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccaa940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c63e6d-1dfe-4772-affc-638938210ba4:14348:1874625922428160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787782960.820519:0:14348:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782960.820524:0:14348:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782960.820526:0:14348:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787782960.820531:0:14348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787782960.820638:0:14312:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1787782960.820663:0:14312:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787782960.820684:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255800/0x6d98ed19b638084 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63808b expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.820695:0:14312:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141255800/0x6d98ed19b638084 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63808b expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782960.820704:0:14312:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c3129e3b800 from 1 10000000:01000000:0.0:1787782960.820716:0:14312:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787782960.820743:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.820759:0:14312:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.820769:0:14312:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638102 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782960.820785:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922428288:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787782960.820822:0:14312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782960.820863:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129660540 going to sleep for 11 seconds 00000100:00100000:3.0:1787782960.820956:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922428288 00000100:00100000:3.0:1787782960.820961:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922428288 00000100:00100000:3.0:1787782960.820994:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787782960.821001:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+9:14312:x1874625922428288:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782960.821011:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782960.821033:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31013a0200/0x6d98ed19b638109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b638102 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.821057:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a0200/0x6d98ed19b638109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b638102 expref: 10 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.821067:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31013a0200/0x6d98ed19b638109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b638102 expref: 10 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.821076:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0200, rc 0) 00000100:00100000:3.0:1787782960.821139:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+10:14312:x1874625922428288:12345-0@lo:101:mount.lustre.0 Request processed in 138us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782960.821146:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787782960.821332:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922428288:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782960.821346:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638109 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.821356:0:14312:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638102 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b638109 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782960.822051:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922428416:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787782960.822311:0:14312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782960.822350:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129660540 going to sleep for 11 seconds 00000100:00100000:2.0:1787782960.822441:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922428416 00000100:00100000:2.0:1787782960.822446:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922428416 00000100:00100000:2.0:1787782960.822528:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787782960.822537:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+10:14312:x1874625922428416:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787782960.822554:0:14324:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787782960.822561:0:14324:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787782960.822638:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+10:14312:x1874625922428416:12345-0@lo:256:mount.lustre.0 Request processed in 102us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782960.822645:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787782960.822686:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922428416:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787782960.823417:0:14312:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787782960.823434:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638102 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638109 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.823445:0:14312:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638109 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782960.823615:0:14312:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3129e3b800 from 1 10000000:01000000:0.0:1787782960.823617:0:14312:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787782960.823642:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141254800/0x6d98ed19b638110 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.823648:0:14312:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141254800/0x6d98ed19b638110 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.823653:0:14312:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141254800/0x6d98ed19b638110 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782960.823667:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922428544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787782960.823705:0:14312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782960.823833:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129660540 going to sleep for 11 seconds 00000100:00100000:3.0:1787782960.823842:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922428544 00000100:00100000:3.0:1787782960.823847:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922428544 00000100:00100000:3.0:1787782960.823882:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787782960.823890:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+10:14312:x1874625922428544:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782960.823900:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782960.823914:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b638117 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b638110 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.823935:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b638117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b638110 expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.823946:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b638117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b638110 expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.823955:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0a00, rc 0) 00000100:00100000:3.0:1787782960.823997:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+11:14312:x1874625922428544:12345-0@lo:101:mount.lustre.0 Request processed in 108us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782960.824003:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787782960.824141:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922428544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782960.824155:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141254800/0x6d98ed19b638110 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638117 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.824163:0:14312:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141254800/0x6d98ed19b638110 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b638117 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782960.824213:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922428672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782960.824250:0:14312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782960.824275:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129660540 going to sleep for 11 seconds 00000100:00100000:2.0:1787782960.824582:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922428672 00000100:00100000:2.0:1787782960.824598:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922428672 00000100:00100000:2.0:1787782960.824633:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787782960.824641:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+11:14312:x1874625922428672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782960.825677:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+11:14312:x1874625922428672:12345-0@lo:501:mount.lustre.0 Request processed in 1034us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782960.825686:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787782960.825696:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922428672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782960.825755:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922428800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787782960.825797:0:14312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782960.825838:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3132166a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787782960.826028:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922428800 00000100:00100000:3.0:1787782960.826034:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922428800 00000100:00100000:3.0:1787782960.826072:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787782960.826080:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+11:14312:x1874625922428800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782960.826670:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+11:14312:x1874625922428800:12345-0@lo:503:mount.lustre.0 Request processed in 589us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782960.826677:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787782960.827024:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922428800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787782960.827817:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c63e6d-1dfe-4772-affc-638938210ba4:14356:1874625922428928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787782960.827877:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782960.827916:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31321669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782960.828138:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922428928 00000100:00100000:2.0:1787782960.828153:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922428928 00000100:00100000:2.0:1787782960.828195:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787782960.828204:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+11:14356:x1874625922428928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782960.828526:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+11:14356:x1874625922428928:12345-0@lo:502:llog_process_th.0 Request processed in 322us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782960.828533:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787782960.828615:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c63e6d-1dfe-4772-affc-638938210ba4:14356:1874625922428928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787782960.828642:0:14356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782960.828652:0:14356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782960.828654:0:14356:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787782960.828661:0:14356:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c3129e3b800 00000020:00000080:1.0:1787782960.828664:0:14356:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787782960.828672:0:14356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782960.828675:0:14356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782960.828676:0:14356:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787782960.828679:0:14356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782960.828681:0:14356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782960.828683:0:14356:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787782960.828686:0:14356:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c3129e3b800 00000020:00000080:1.0:1787782960.828688:0:14356:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787782960.828754:0:14356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782960.828758:0:14356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782960.828759:0:14356:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787782960.828762:0:14356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782960.828764:0:14356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782960.828765:0:14356:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787782960.828776:0:14356:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c3129e3b800 00000020:00000080:1.0:1787782960.828778:0:14356:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787782960.828817:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c63e6d-1dfe-4772-affc-638938210ba4:14356:1874625922429056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787782960.828853:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782960.828887:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31321669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782960.829071:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922429056 00000100:00100000:2.0:1787782960.829076:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922429056 00000100:00100000:2.0:1787782960.829138:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787782960.829146:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+11:14356:x1874625922429056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782960.829315:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+11:14356:x1874625922429056:12345-0@lo:502:llog_process_th.0 Request processed in 169us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782960.829321:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787782960.829413:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c63e6d-1dfe-4772-affc-638938210ba4:14356:1874625922429056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787782960.829436:0:14356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782960.829440:0:14356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782960.829443:0:14356:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787782960.829456:0:14356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787782960.829549:0:14312:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787782960.829569:0:14312:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787782960.829592:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141254800/0x6d98ed19b638110 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638117 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782960.829604:0:14312:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141254800/0x6d98ed19b638110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638117 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782960.829648:0:14312:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787782960.829651:0:14312:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c3129e3b800 10000000:01000000:2.0:1787782960.829654:0:14312:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c3129e3b800 10000000:01000000:2.0:1787782960.829658:0:14312:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787782960.829663:0:14312:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c3129e3b800 from 1 10000000:01000000:2.0:1787782960.829665:0:14312:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787782960.829691:0:14312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141205400/0x6d98ed19b63811e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782960.829706:0:14312:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141205400/0x6d98ed19b63811e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782960.829715:0:14312:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141205400/0x6d98ed19b63811e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782960.829731:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922429184:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787782960.829837:0:14312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782960.829866:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31123f46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782960.829880:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922429184 00000100:00100000:3.0:1787782960.829885:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922429184 00000100:00100000:3.0:1787782960.829915:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787782960.829923:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+11:14312:x1874625922429184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782960.829939:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782960.829950:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31013a0400/0x6d98ed19b638125 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b63811e expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.829972:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a0400/0x6d98ed19b638125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b63811e expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.829981:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31013a0400/0x6d98ed19b638125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b63811e expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.829988:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0400, rc 0) 00000100:00100000:3.0:1787782960.830026:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+12:14312:x1874625922429184:12345-0@lo:101:mount.lustre.0 Request processed in 104us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782960.830032:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787782960.830138:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922429184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782960.830151:0:14312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141205400/0x6d98ed19b63811e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638125 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782960.830160:0:14312:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141205400/0x6d98ed19b63811e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b638125 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782960.830204:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922429312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782960.830341:0:14312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782960.830369:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31123f46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782960.830432:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922429312 00000100:00100000:3.0:1787782960.830438:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922429312 00000100:00100000:3.0:1787782960.830476:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787782960.830482:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+12:14312:x1874625922429312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782960.830714:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+12:14312:x1874625922429312:12345-0@lo:501:mount.lustre.0 Request processed in 231us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782960.830722:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787782960.830854:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922429312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782960.830880:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922429440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782960.830919:0:14312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782960.830944:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31123f46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782960.831021:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922429440 00000100:00100000:3.0:1787782960.831026:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922429440 00000100:00100000:3.0:1787782960.831051:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787782960.831057:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+12:14312:x1874625922429440:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782960.831283:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+12:14312:x1874625922429440:12345-0@lo:503:mount.lustre.0 Request processed in 225us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782960.831299:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787782960.831386:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922429440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782960.831735:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c63e6d-1dfe-4772-affc-638938210ba4:14357:1874625922429568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782960.831854:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782960.831918:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31123f4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787782960.832535:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922429568 00000100:00100000:3.0:1787782960.832541:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922429568 00000100:00100000:3.0:1787782960.832854:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787782960.832864:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+12:14357:x1874625922429568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787782960.835260:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+12:14357:x1874625922429568:12345-0@lo:502:llog_process_th.0 Request processed in 2385us (3395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782960.835275:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787782960.838250:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c63e6d-1dfe-4772-affc-638938210ba4:14357:1874625922429568:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1787782960.838336:0:14357:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787782960.838354:0:14357:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8c3134383370) 00000020:00000080:2.0:1787782960.838376:0:14357:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1787782960.838461:0:14357:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c3129e3b800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787782960.838466:0:14357:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c3129e3b800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787782960.838469:0:14357:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c3129e3b800 4 00010000:00080000:2.0:1787782960.838498:0:14357:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c310712e800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.115@tcp at head 00010000:00010000:2.0:1787782960.845596:0:14357:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787782960.845805:0:14357:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787782960.845839:0:14357:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787782960.845852:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6d98ed19b638133 00000100:00080000:2.0:1787782960.845863:0:14357:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787782960.845869:0:14357:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c310712e800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787782960.845924:0:14357:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c31346fed00 x1874625922429696/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787782960.845964:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625922429696:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787782960.846055:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787782960.852560:0:14357:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787782960.852603:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922429696 00000100:00100000:1.0:1787782960.852614:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922429696 00000100:00100000:1.0:1787782960.852650:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782960.852659:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874625922429696:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787782960.852811:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874625922429696:12345-0@lo:38:llog_process_th.0 Request processed in 93us (6698us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787782960.852821:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782960.856402:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787782960.856416:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c310712e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782960.856422:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787782960.856425:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625922429696:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787782960.856549:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c63e6d-1dfe-4772-affc-638938210ba4:14357:1874625922429824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782960.856613:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782960.856645:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922429824 00000100:00100000:2.0:1787782960.856649:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922429824 00000100:00100000:2.0:1787782960.856680:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787782960.856686:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+12:14357:x1874625922429824:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787782960.856904:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+12:14357:x1874625922429824:12345-0@lo:502:llog_process_th.0 Request processed in 218us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782960.856911:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787782960.857002:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31123f4840 going to sleep for 11 seconds 00000100:00100000:2.0:1787782960.857013:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:48c63e6d-1dfe-4772-affc-638938210ba4:14357:1874625922429824:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787782960.857410:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787782960.858206:0:14312:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787782960.858230:0:14312:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787782960.858246:0:14312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141205400/0x6d98ed19b63811e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638125 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782960.858266:0:14312:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141205400/0x6d98ed19b63811e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638125 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787782960.858315:0:14312:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787782960.858317:0:14312:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787782960.858319:0:14312:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782960.858320:0:14312:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782960.858321:0:14312:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782960.858323:0:14312:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782960.858324:0:14312:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787782960.858326:0:14312:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787782960.858327:0:14312:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782960.858329:0:14312:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787782960.858333:0:14312:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787782960.858340:0:14312:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787782960.858341:0:14312:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787782960.858342:0:14312:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782960.858343:0:14312:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782960.858344:0:14312:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782960.858345:0:14312:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782960.858346:0:14312:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787782960.858347:0:14312:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787782960.858348:0:14312:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782960.858349:0:14312:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787782960.858370:0:14312:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787782960.858386:0:14312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922429952:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787782960.858436:0:14312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782960.858470:0:14312:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31123f4840 going to sleep for 11 seconds 00000100:00100000:3.0:1787782960.859204:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922429952 00000100:00100000:3.0:1787782960.859214:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922429952 00000100:00100000:3.0:1787782960.859342:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787782960.859352:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+12:14312:x1874625922429952:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787782960.859380:0:14324:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787782960.859392:0:14324:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787782960.919162:0:14324:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787782960.919179:0:14324:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787782960.919338:0:14346:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787782960.919344:0:14346:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787782960.919370:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c3141255400/0x6d98ed19b63813a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.919402:0:14346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31013a0200/0x6d98ed19b638109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b638102 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.919411:0:14346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c3141255400/0x6d98ed19b63813a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.919462:0:14346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31013a0200/0x6d98ed19b638109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b638102 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782960.919476:0:14346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c31013a0200/0x6d98ed19b638109 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b638102 expref: 12 pid: 14323 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782960.919491:0:14346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14346:1874625922430080:0@lo:104: 00000100:00100000:0.0:1787782960.919557:0:14346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782960.919607:0:14346:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129660180 going to sleep for 11 seconds 00000100:00100000:2.0:1787782960.919864:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922430080 00000100:00100000:2.0:1787782960.919872:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922430080 00000100:00100000:2.0:1787782960.919924:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782960.919933:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c63e6d-1dfe-4772-affc-638938210ba4+3:14346:x1874625922430080:12345-0@lo:104: 00010000:00010000:2.0:1787782960.919947:0:14313:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b638109 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782960.920001:0:14313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787782960.920006:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c63e6d-1dfe-4772-affc-638938210ba4+3:14346:x1874625922430080:12345-0@lo:104: Request processed in 75us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782960.920013:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787782960.920062:0:14346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14346:1874625922430080:0@lo:104: 00010000:00010000:2.0:1787782960.920080:0:14346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c3141255400/0x6d98ed19b63813a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.920416:0:14319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782960.920424:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b638109 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.920432:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255a00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782960.920436:0:14319:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638102 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b638109 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.920443:0:14319:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b638109 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782960.920511:0:14319:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b638109 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782960.920526:0:14319:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787782960.921043:0:14319:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638102 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b638109 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.921052:0:14319:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782960.921084:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638102 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b638109 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.921092:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638102 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b638109 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782960.921138:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782960.921140:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782960.921142:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782960.921165:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787782960.921179:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c63e6d-1dfe-4772-affc-638938210ba4:3307:1874625922430208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782960.921241:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782960.921695:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922430208 00000100:00100000:1.0:1787782960.921703:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922430208 00010000:00010000:1.0:1787782960.921730:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31013a0200/0x6d98ed19b638109 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b638102 expref: 13 pid: 14323 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782960.921879:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782960.921888:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48c63e6d-1dfe-4772-affc-638938210ba4+13:3307:x1874625922430208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787782960.921902:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787782960.921908:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31013a0200/0x6d98ed19b638109 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b638102 expref: 13 pid: 14323 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.921920:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31013a0200/0x6d98ed19b638109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b638102 expref: 13 pid: 14323 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.921946:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31013a0200/0x6d98ed19b638109 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b638102 expref: 13 pid: 14323 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.921961:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c3141255400/0x6d98ed19b63813a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.921969:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141255400/0x6d98ed19b63813a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787782960.921984:0:14315:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002641823s 00010000:00010000:1.0:1787782960.921988:0:14315:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3141255400/0x6d98ed19b63813a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.921995:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3141255400/0x6d98ed19b63813a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.922000:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c3141255400/0x6d98ed19b63813a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.922006:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c3141255400/0x6d98ed19b63813a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.922010:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255400 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782960.922014:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c3141255400/0x6d98ed19b63813a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.922020:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c3141255400/0x6d98ed19b63813a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.922045:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c3141255400/0x6d98ed19b63813a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782960.922065:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782960.922138:0:14346:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c3141255400/0x6d98ed19b63813a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782960.922155:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c3141255400/0x6d98ed19b63813a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782960.922158:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:48c63e6d-1dfe-4772-affc-638938210ba4+12:3307:x1874625922430208:12345-0@lo:103:ldlm_bl.0 Request processed in 272us (917us total) trans 0 rc 0/0 00010000:00010000:2.0:1787782960.922162:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3141255400/0x6d98ed19b63813a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782960.922166:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782960.922564:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccaa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c63e6d-1dfe-4772-affc-638938210ba4:3307:1874625922430208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782960.926354:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+11:14312:x1874625922429952:12345-0@lo:253:mount.lustre.0 Request processed in 66993us (67907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782960.926371:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787782960.926409:0:14312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:14312:1874625922429952:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787782960.926427:0:14312:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787782960.926431:0:14312:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787782960.926433:0:14312:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787782960.926434:0:14312:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782960.926436:0:14312:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782960.926437:0:14312:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782960.926438:0:14312:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782960.926439:0:14312:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787782960.926441:0:14312:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787782960.926443:0:14312:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782960.926444:0:14312:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787782960.926460:0:14312:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787782960.935530:0:14312:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782960.935887:0:14312:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787782960.936971:0:14312:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782960.938676:0:14312:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787782960.939054:0:14312:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782960.940259:0:14312:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787782960.940913:0:14312:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782960.941041:0:14312:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787782960.941472:0:14312:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782960.941695:0:14312:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787782960.941960:0:14312:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782960.942625:0:14312:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1787782960.967643:0:14312:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787782960.968623:0:14312:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787782960.968832:0:14367:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787782960.968837:0:14367:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1787782960.969146:0:14368:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787782960.969243:0:14368:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787782960.971736:0:14368:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787782960.972155:0:14368:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787782960.972160:0:14368:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1787782960.975380:0:14312:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787782960.975511:0:14312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787782960.976853:0:14312:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787782960.976890:0:14312:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787782960.977474:0:14312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787782960.978556:0:14312:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787782960.979181:0:14312:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787782960.979216:0:14312:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1787782960.980976:0:14312:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1787782960.986907:0:14312:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787782961.068884:0:14312:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787782961.068924:0:14312:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb0afc0f67988 00100000:10000000:2.0:1787782961.068944:0:14312:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787782961.069851:0:14312:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787782961.069869:0:14312:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787782961.069883:0:14312:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787782961.069910:0:14312:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787782961.572301:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787782961.889981:0:14364:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787782962.148608:0:14327:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787782962.148617:0:14327:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c3129e3b800 from 6 10000000:01000000:0.0:1787782962.148622:0:14327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787782962.148705:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141254e00/0x6d98ed19b638141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782962.148734:0:14327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141254e00/0x6d98ed19b638141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782962.148748:0:14327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141254e00/0x6d98ed19b638141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782962.148791:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922430336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787782962.148869:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782962.148933:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129660000 going to sleep for 11 seconds 00000100:00100000:1.0:1787782962.149009:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922430336 00000100:00100000:1.0:1787782962.149026:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922430336 00000100:00100000:1.0:1787782962.149081:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787782962.149124:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+11:14327:x1874625922430336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782962.149138:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782962.149152:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3140cc6a00/0x6d98ed19b638148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b638141 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782962.149175:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3140cc6a00/0x6d98ed19b638148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b638141 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782962.149184:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3140cc6a00/0x6d98ed19b638148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b638141 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782962.149193:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc6a00, rc 0) 00000100:00100000:1.0:1787782962.149233:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+12:14327:x1874625922430336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782962.149239:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787782962.149467:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922430336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782962.149482:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141254e00/0x6d98ed19b638141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638148 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782962.149490:0:14327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141254e00/0x6d98ed19b638141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b638148 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782962.149542:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922430464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787782962.149571:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782962.149592:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129660000 going to sleep for 11 seconds 00000100:00100000:1.0:1787782962.154590:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922430464 00000100:00100000:1.0:1787782962.154609:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922430464 00000100:00100000:1.0:1787782962.154693:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787782962.154703:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+12:14327:x1874625922430464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787782962.154733:0:14324:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787782962.154752:0:14324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787782962.154755:0:14324:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787782962.154896:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+12:14327:x1874625922430464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 194us (5323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782962.154905:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787782962.154961:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922430464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787782962.155012:0:14327:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787782962.155036:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141254e00/0x6d98ed19b638141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638148 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782962.155047:0:14327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141254e00/0x6d98ed19b638141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638148 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782962.595420:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787782962.914757:0:14364:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787782963.617333:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782964.641912:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782965.672662:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787782965.863755:0:13877:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782965.863763:0:13877:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787782965.863765:0:13877:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782965.863768:0:13877:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787782965.863772:0:13877:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787782965.863775:0:13877:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787782965.863789:0:13877:0:(import.c:65:import_set_state_nolock()) ffff8c310712e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787782965.863802:0:13877:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c310712e800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:2.0:1787782965.863826:0:13877:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c31346fd2c0 x1874625922430720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787782965.863862:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c63e6d-1dfe-4772-affc-638938210ba4:3307:1874625922430592:0@lo:400:kworker.0 00000100:00100000:2.0:1787782965.864136:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782965.864223:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625922430720:0@lo:38:kworker.0 00000100:00100000:2.0:1787782965.864255:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782965.864291:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922430592 00000100:00100000:2.0:1787782965.864298:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922430592 00000100:00100000:2.0:1787782965.864344:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787782965.864353:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+12:3307:x1874625922430592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782965.864405:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+12:3307:x1874625922430592:12345-0@lo:400:kworker.0 Request processed in 52us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782965.864412:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787782965.865350:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c63e6d-1dfe-4772-affc-638938210ba4:3307:1874625922430592:0@lo:400:kworker.0 00000100:00100000:0.0:1787782965.869613:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922430720 00000100:00100000:0.0:1787782965.869631:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922430720 00000100:00100000:0.0:1787782965.869691:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787782965.869701:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874625922430720:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787782965.869731:0:14332:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:0.0:1787782965.869771:0:14332:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6d98ed19b63814f 00000004:00100000:0.0:1787782965.869796:0:14332:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787782965.869937:0:14332:0:(import.c:65:import_set_state_nolock()) ffff8c313c7cb000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787782965.870070:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874625922430720:12345-0@lo:38:kworker.0 Request processed in 369us (5813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782965.870078:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787782965.870155:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c31346fd2c0 x1874625922430720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787782975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787782965.870173:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787782965.870181:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787782965.870187:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787782965.870189:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c310712e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787782965.870196:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874625922430720:0@lo:38:kworker.0 00000001:02000400:3.0:1787782966.514424:0:14611:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787782966.692991:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782967.714356:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782968.737689:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782969.764140:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787782970.115758:0:14762:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0f3f90d0 20000000:00000080:3.0:1787782970.115773:0:14762:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c3141c72400 uarg=0000000000000000 20000000:01000000:3.0:1787782970.115798:0:14762:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787782970.115804:0:14762:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787782970.115808:0:14762:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787782970.117132:0:14763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787782970.117249:0:14762:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787782970.120808:0:14762:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787782970.120841:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c3141204a00/0x6d98ed19b638156 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782970.120860:0:14762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b638117 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b638110 expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782970.120868:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c3141204a00/0x6d98ed19b638156 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782970.120905:0:14762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b638117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b638110 expref: 11 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782970.120916:0:14762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b638117 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b638110 expref: 11 pid: 14323 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782970.120927:0:14762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14762:1874625922430848:0@lo:104: 00000100:00100000:2.0:1787782970.120995:0:14762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782970.121063:0:14762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d0cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787782970.121348:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922430848 00000100:00100000:1.0:1787782970.121356:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922430848 00000100:00100000:1.0:1787782970.121453:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787782970.121463:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48c63e6d-1dfe-4772-affc-638938210ba4+3:14762:x1874625922430848:12345-0@lo:104: 00010000:00010000:1.0:1787782970.121477:0:14314:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c3141254800/0x6d98ed19b638110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b638117 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782970.121551:0:14314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1787782970.121557:0:14319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787782970.121558:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48c63e6d-1dfe-4772-affc-638938210ba4+3:14762:x1874625922430848:12345-0@lo:104: Request processed in 97us (562us total) trans 0 rc 0/0 00010000:00010000:3.0:1787782970.121564:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3141254800/0x6d98ed19b638110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b638117 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782970.121565:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787782970.121571:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254800 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782970.121575:0:14319:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3141254800/0x6d98ed19b638110 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b638117 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782970.121583:0:14319:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3141254800/0x6d98ed19b638110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b638117 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782970.121590:0:14319:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3141254800/0x6d98ed19b638110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b638117 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782970.121596:0:14319:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787782970.121632:0:14319:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3141254800/0x6d98ed19b638110 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b638117 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782970.121638:0:14319:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782970.121657:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3141254800/0x6d98ed19b638110 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b638117 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782970.121660:0:14762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14762:1874625922430848:0@lo:104: 00010000:00010000:3.0:1787782970.121664:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3141254800/0x6d98ed19b638110 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b638117 expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782970.121678:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782970.121678:0:14762:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c3141204a00/0x6d98ed19b638156 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782970.121680:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782970.121682:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782970.121709:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccaa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c63e6d-1dfe-4772-affc-638938210ba4:3304:1874625922430976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782970.121740:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782970.121814:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922430976 00000100:00100000:0.0:1787782970.121818:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922430976 00010000:00010000:0.0:1787782970.121834:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b638117 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b638110 expref: 12 pid: 14323 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782970.121855:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787782970.121862:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48c63e6d-1dfe-4772-affc-638938210ba4+12:3304:x1874625922430976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787782970.121872:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782970.121878:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b638117 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b638110 expref: 12 pid: 14323 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782970.121898:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b638117 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b638110 expref: 12 pid: 14323 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782970.121910:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31013a0a00/0x6d98ed19b638117 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b638110 expref: 12 pid: 14323 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782970.121919:0:14316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c3141204a00/0x6d98ed19b638156 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782970.121925:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141204a00/0x6d98ed19b638156 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782970.121934:0:14316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3141204a00/0x6d98ed19b638156 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782970.121938:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3141204a00/0x6d98ed19b638156 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782970.121951:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c3141204a00/0x6d98ed19b638156 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782970.121958:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c3141204a00/0x6d98ed19b638156 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782970.121962:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204a00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782970.121974:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c3141204a00/0x6d98ed19b638156 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782970.121983:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c3141204a00/0x6d98ed19b638156 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782970.122019:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c3141204a00/0x6d98ed19b638156 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782970.122030:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787782970.122047:0:14762:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c3141204a00/0x6d98ed19b638156 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782970.122055:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c3141204a00/0x6d98ed19b638156 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782970.122061:0:14762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3141204a00/0x6d98ed19b638156 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782970.122072:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccabc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:48c63e6d-1dfe-4772-affc-638938210ba4+11:3304:x1874625922430976:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782970.122078:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787782970.122332:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccaa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c63e6d-1dfe-4772-affc-638938210ba4:3304:1874625922430976:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787782970.785837:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782970.977321:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782960/real 1787782960] req@ffff8c313ccab840 x1874625922428032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782970 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782970.977352:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c313ccab840 x1874625922428032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782970 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782970.977364:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782960/real 1787782960] req@ffff8c31411d1e00 x1874625922427904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782970 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782970.977374:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c31411d1e00 x1874625922427904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782970 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787782970.977393:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c3001e17000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787782970.977417:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787782970.977421:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922428032:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787782970.977427:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c3132180000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787782970.977432:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787782970.977435:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922427904:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787782970.977551:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782970.977556:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787782970.977559:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3132180000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787782970.977564:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 445 00000100:00080000:1.0:1787782970.977570:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787782970.977576:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c3132180000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787782970.977597:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c31411d1680 x1874625922431232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787782970.977611:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782970.977615:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787782970.977616:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3001e17000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787782970.977619:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 445 00000100:00080000:1.0:1787782970.977622:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787782970.977625:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c3001e17000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787782970.977637:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c31411d0000 x1874625922431360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787782970.977680:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922431488:0@lo:400:kworker.0 00000100:00100000:1.0:1787782970.977745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782970.977819:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922431488 00000100:00100000:1.0:1787782970.977836:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922431488 00000100:00100000:1.0:1787782970.977888:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787782970.977897:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922431488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782970.977961:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922431488:12345-0@lo:400:kworker.0 Request processed in 65us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782970.977967:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787782970.977999:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c31411d30c0 x1874625922431488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782970.978020:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922431488:0@lo:400:kworker.0 00000100:00100000:3.0:1787782970.978074:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c63e6d-1dfe-4772-affc-638938210ba4:3305:1874625922431104:0@lo:400:kworker.0 00000100:00100000:3.0:1787782970.978142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782970.980024:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922431104 00000100:00100000:1.0:1787782970.980038:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922431104 00000100:00100000:1.0:1787782970.980123:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787782970.980136:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+11:3305:x1874625922431104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782970.980360:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+11:3305:x1874625922431104:12345-0@lo:400:kworker.0 Request processed in 227us (2216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782970.980368:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787782970.980510:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922431232:0@lo:8:kworker.0 00000400:00000100:0.0:1787782970.980545:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874625922431232 offset 0 length 520: 4 00000100:00100000:0.0:1787782970.980590:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922431360:0@lo:8:kworker.0 00000400:00000100:0.0:1787782970.980609:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874625922431360 offset 0 length 520: 4 00000100:00100000:3.0:1787782970.980720:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c63e6d-1dfe-4772-affc-638938210ba4:3305:1874625922431104:0@lo:400:kworker.0 10000000:01000000:3.0:1787782971.745174:0:14327:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787782971.745180:0:14327:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3129e3b800 from 10 10000000:01000000:3.0:1787782971.745184:0:14327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787782971.745232:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b63815d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782971.745243:0:14327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b63815d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782971.745254:0:14327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b63815d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782971.745284:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccaa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922431616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787782971.745345:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782971.745396:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102e5af00 going to sleep for 11 seconds 00000100:00100000:0.0:1787782971.745647:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922431616 00000100:00100000:0.0:1787782971.745655:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922431616 00000100:00100000:0.0:1787782971.745736:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787782971.745747:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+11:14327:x1874625922431616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782971.745760:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782971.745773:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141255200/0x6d98ed19b638164 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b63815d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782971.745796:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141255200/0x6d98ed19b638164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b63815d expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782971.745806:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141255200/0x6d98ed19b638164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b63815d expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782971.745815:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255200, rc 0) 00000100:00100000:0.0:1787782971.745866:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+12:14327:x1874625922431616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782971.745873:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787782971.745923:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccaa1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922431616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787782971.746392:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b63815d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638164 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782971.746417:0:14327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b63815d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b638164 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782971.746691:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922431744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787782971.746730:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782971.746766:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787782971.747951:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922431744 00000100:00100000:1.0:1787782971.747962:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922431744 00000100:00100000:1.0:1787782971.748017:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787782971.748025:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+12:14327:x1874625922431744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787782971.748323:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+12:14327:x1874625922431744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782971.748331:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787782971.748541:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922431744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787782971.748614:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346ff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922431872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787782971.748661:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782971.748699:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3108bb00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782971.748728:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922431872 00000100:00100000:3.0:1787782971.748733:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922431872 00000100:00100000:3.0:1787782971.748766:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787782971.748774:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+12:14327:x1874625922431872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787782971.748920:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+12:14327:x1874625922431872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782971.749190:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787782971.749235:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346ff840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922431872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787782971.750556:0:14830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787782971.750618:0:14327:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787782971.750641:0:14327:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787782971.750651:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b63815d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638164 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782971.750675:0:14327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b63815d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638164 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782971.810276:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787782972.131193:0:14364:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787782972.835164:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782973.864646:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782974.882995:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787782974.943070:0:15010:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787782974.943075:0:15010:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787782974.943223:0:15010:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c3107128000 00000020:01000004:2.0:1787782974.943241:0:15010:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787782974.943255:0:15010:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787782974.943285:0:15010:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8c3141ef19b8) 00000020:00000080:2.0:1787782974.943303:0:15010:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787782974.958127:0:15010:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787782974.958394:0:15010:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787782974.959390:0:15010:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787782974.959625:0:15010:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787782974.959918:0:15010:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787782974.960385:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1787782974.960546:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1787782974.960635:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1787782974.962634:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 477: rc = 0 00100000:10000000:2.0:1787782974.963374:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 477: rc = 0 00100000:10000000:2.0:1787782974.963635:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 477: rc = 0 00100000:10000000:2.0:1787782974.964051:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 477: rc = 0 00100000:10000000:2.0:1787782974.964389:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 477: rc = 0 00100000:10000000:2.0:1787782974.964632:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 477: rc = 0 00000020:00000080:2.0:1787782974.966588:0:15010:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787782974.966601:0:15010:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787782974.966618:0:15010:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6d98ed19b638172 00000020:01000004:2.0:1787782974.966627:0:15010:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787782974.966648:0:15010:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.115@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787782974.966651:0:15010:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787782974.966662:0:15010:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787782974.966666:0:15010:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787782974.966677:0:15010:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8c3141ef4d28) 00000020:00000080:2.0:1787782974.966691:0:15010:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787782974.971106:0:15010:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782974.971280:0:15010:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787782974.971286:0:15010:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787782974.972846:0:15010:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787782974.972858:0:15010:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787782974.973370:0:15010:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787782974.973375:0:15010:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787782974.976825:0:15010:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787782974.977080:0:15010:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787782974.977087:0:15010:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787782974.977647:0:15010:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787782974.977652:0:15010:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787782975.002904:0:15010:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787782975.004300:0:15010:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787782975.004308:0:15010:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787782975.010387:0:15010:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787782975.010410:0:15010:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787782975.011567:0:15010:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787782975.011580:0:15010:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787782975.013603:0:15010:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787782975.013931:0:15010:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787782975.013938:0:15010:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787782975.014642:0:15010:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787782975.014649:0:15010:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787782975.043608:0:15010:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787782975.043825:0:15010:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787782975.043833:0:15010:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787782975.045018:0:15010:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787782975.045028:0:15010:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787782975.045749:0:15010:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787782975.045773:0:15010:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787782975.045779:0:15010:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787782975.054605:0:15010:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787782975.054658:0:15010:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.115@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787782975.054663:0:15010:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787782975.054665:0:15010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787782975.054666:0:15010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782975.054667:0:15010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782975.054668:0:15010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782975.054670:0:15010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782975.054671:0:15010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782975.054673:0:15010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782975.054674:0:15010:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787782975.054678:0:15010:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787782975.054685:0:15010:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787782975.054686:0:15010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787782975.054687:0:15010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782975.054688:0:15010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782975.054689:0:15010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782975.054690:0:15010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782975.054691:0:15010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782975.054692:0:15010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782975.054693:0:15010:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787782975.054720:0:15010:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787782975.054740:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922432000:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787782975.054812:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782975.054940:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310690b900 going to sleep for 11 seconds 00000100:00100000:1.0:1787782975.055024:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922432000 00000100:00100000:1.0:1787782975.055032:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922432000 00000100:00100000:1.0:1787782975.055175:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787782975.055184:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+12:15010:x1874625922432000:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787782975.055215:0:14323:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787782975.055218:0:14323:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787782975.055222:0:14323:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787782975.059513:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+12:15010:x1874625922432000:12345-0@lo:253:mount.lustre.0 Request processed in 4320us (4690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782975.059528:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787782975.059618:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922432000:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787782975.059635:0:15010:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787782975.059639:0:15010:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787782975.059641:0:15010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787782975.059643:0:15010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782975.059644:0:15010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782975.059645:0:15010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782975.059647:0:15010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782975.059648:0:15010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782975.059651:0:15010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782975.059652:0:15010:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787782975.059673:0:15010:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c3107128000 from lustre-OST0000 10000000:01000000:2.0:1787782975.059702:0:15010:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787782975.059706:0:15010:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787782975.059713:0:15010:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c31343819b8 local copy 00010000:00010000:2.0:1787782975.059724:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141205600/0x6d98ed19b638068 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63806f expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782975.060073:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922432128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782975.060264:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782975.060353:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31061e0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782975.060401:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922432128 00000100:00100000:3.0:1787782975.060408:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922432128 00000100:00100000:3.0:1787782975.060484:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787782975.060493:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+12:15010:x1874625922432128:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782975.060676:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+12:15010:x1874625922432128:12345-0@lo:501:mount.lustre.0 Request processed in 184us (411us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787782975.060684:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787782975.060760:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922432128:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787782975.060776:0:15010:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787782975.060981:0:15010:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787782975.060989:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141205600/0x6d98ed19b638068 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63806f expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.060998:0:15010:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141205600/0x6d98ed19b638068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63806f expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782975.061035:0:15010:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c3107128000 10000000:01000000:0.0:1787782975.061041:0:15010:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787782975.061046:0:15010:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8c31343819b8 10000000:01000000:0.0:1787782975.061049:0:15010:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787782975.061052:0:15010:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8c31343819b8 from 1 10000000:01000000:0.0:1787782975.061055:0:15010:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787782975.061082:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638180 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.061091:0:15010:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638180 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.061121:0:15010:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638180 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782975.061136:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922432256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787782975.061181:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782975.061476:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107d8e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782975.061519:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922432256 00000100:00100000:2.0:1787782975.061524:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922432256 00000100:00100000:2.0:1787782975.061549:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787782975.061556:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+12:15010:x1874625922432256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782975.061565:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782975.061578:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141204000/0x6d98ed19b638187 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b638180 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.061600:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141204000/0x6d98ed19b638187 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b638180 expref: 13 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.061612:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141204000/0x6d98ed19b638187 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b638180 expref: 13 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.061621:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204000, rc 0) 00000100:00100000:2.0:1787782975.061666:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+13:15010:x1874625922432256:12345-0@lo:101:mount.lustre.0 Request processed in 110us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782975.061672:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787782975.061751:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922432256:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782975.061766:0:15010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638180 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638187 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.061775:0:15010:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638180 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b638187 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782975.061793:0:15010:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787782975.061814:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638180 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638187 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.061834:0:15010:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141255a00/0x6d98ed19b638180 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638187 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782975.061841:0:15010:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787782975.061845:0:15010:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787782975.061850:0:15010:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787782975.061853:0:15010:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787782975.061870:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b63818e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.061878:0:15010:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b63818e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.061886:0:15010:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b63818e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782975.061912:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922432384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787782975.061940:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782975.061976:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107d8e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787782975.062156:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922432384 00000100:00100000:2.0:1787782975.062161:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922432384 00000100:00100000:2.0:1787782975.062180:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787782975.062186:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+13:15010:x1874625922432384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782975.062194:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782975.062202:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141205a00/0x6d98ed19b638195 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b63818e expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.062217:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141205a00/0x6d98ed19b638195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b63818e expref: 14 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.062226:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141205a00/0x6d98ed19b638195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b63818e expref: 14 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.062239:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141205a00, rc 0) 00000100:00100000:2.0:1787782975.062266:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+14:15010:x1874625922432384:12345-0@lo:101:mount.lustre.0 Request processed in 80us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782975.062272:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787782975.062479:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922432384:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787782975.062493:0:15010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b63818e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638195 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.062501:0:15010:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b63818e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b638195 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787782975.063365:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787782975.064633:0:15010:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787782975.064911:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787782975.065059:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787782975.065219:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787782975.065276:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787782975.065315:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787782975.065348:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787782975.065416:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787782975.065425:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787782975.065508:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922432512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782975.065572:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782975.065627:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107d8e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787782975.065701:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922432512 00000100:00100000:3.0:1787782975.065709:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922432512 00000100:00100000:3.0:1787782975.065766:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787782975.065776:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+14:15010:x1874625922432512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782975.066288:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+14:15010:x1874625922432512:12345-0@lo:501:mount.lustre.0 Request processed in 511us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782975.066297:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787782975.066552:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922432512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782975.066593:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922432640:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787782975.066636:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782975.066669:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107d8e000 going to sleep for 11 seconds 00000100:00100000:3.0:1787782975.066744:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922432640 00000100:00100000:3.0:1787782975.066750:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922432640 00000100:00100000:3.0:1787782975.066785:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787782975.066792:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+14:15010:x1874625922432640:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782975.067371:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+14:15010:x1874625922432640:12345-0@lo:503:mount.lustre.0 Request processed in 579us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782975.067379:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787782975.067624:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922432640:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787782975.069046:0:15010:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787782975.069259:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922432768:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782975.069330:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782975.069420:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107d8e000 going to sleep for 11 seconds 00000100:00100000:1.0:1787782975.069635:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922432768 00000100:00100000:1.0:1787782975.069642:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922432768 00000100:00100000:1.0:1787782975.069692:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787782975.069703:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+14:15010:x1874625922432768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782975.069950:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+14:15010:x1874625922432768:12345-0@lo:502:mount.lustre.0 Request processed in 248us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782975.070174:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922432768:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787782975.070422:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787782975.070472:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787782975.070505:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787782975.070550:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787782975.070587:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787782975.070619:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787782975.070679:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787782975.070714:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787782975.070766:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787782975.070814:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787782975.070847:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787782975.070892:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787782975.070941:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922432896:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782975.071326:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782975.071356:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107d8e000 going to sleep for 11 seconds 00000100:00100000:1.0:1787782975.071424:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787782975.071465:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922432896 00000100:00100000:1.0:1787782975.071471:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922432896 00000100:00100000:1.0:1787782975.071509:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787782975.071517:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+14:15010:x1874625922432896:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782975.071684:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+14:15010:x1874625922432896:12345-0@lo:502:mount.lustre.0 Request processed in 168us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782975.071691:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787782975.071852:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922432896:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787782975.071941:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787782975.072077:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787782975.073079:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787782975.073088:0:15024:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787782975.073124:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782975.073127:0:15024:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787782975.073135:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787782975.073246:0:15024:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8c3108298000) 00000020:00000080:3.0:1787782975.073269:0:15024:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787782975.073282:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787782975.073342:0:15024:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c3107128000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787782975.073350:0:15024:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787782975.073356:0:15024:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x6d98ed19b6381a3 00010000:00010000:3.0:1787782975.083756:0:15024:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1787782975.084645:0:15024:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1787782975.087072:0:15024:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787782975.090935:0:15024:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787782975.090957:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782975.090964:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782975.090974:0:15024:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787782975.090978:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787782975.090981:0:15024:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787782975.090983:0:15024:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787782975.090984:0:15024:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787782975.090986:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787782975.090988:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782975.090990:0:15024:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787782975.090992:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782975.090995:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782975.090997:0:15024:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787782975.091000:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787782975.091002:0:15024:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787782975.091004:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782975.091006:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782975.091007:0:15024:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787782975.091010:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782975.091012:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782975.091013:0:15024:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787782975.091016:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787782975.091083:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782975.091086:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782975.091087:0:15024:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787782975.091090:0:15024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787782975.091447:0:15010:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787782975.091478:0:15010:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787782975.091498:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b63818e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638195 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782975.091511:0:15010:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141255e00/0x6d98ed19b63818e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638195 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782975.091519:0:15010:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3107128000 from 1 10000000:01000000:1.0:1787782975.091530:0:15010:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787782975.091569:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3140cc7000/0x6d98ed19b6381aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782975.091577:0:15010:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3140cc7000/0x6d98ed19b6381aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782975.091588:0:15010:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3140cc7000/0x6d98ed19b6381aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782975.091615:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922433024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787782975.091687:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782975.091735:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107f22600 going to sleep for 11 seconds 00000100:00100000:3.0:1787782975.091857:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922433024 00000100:00100000:3.0:1787782975.091864:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922433024 00000100:00100000:3.0:1787782975.091909:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787782975.091917:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+14:15010:x1874625922433024:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782975.091930:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782975.091951:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31013a0000/0x6d98ed19b6381b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b6381aa expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782975.091985:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a0000/0x6d98ed19b6381b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b6381aa expref: 15 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782975.091995:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31013a0000/0x6d98ed19b6381b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6381aa expref: 15 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782975.092003:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a0000, rc 0) 00000100:00100000:3.0:1787782975.092042:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+15:15010:x1874625922433024:12345-0@lo:101:mount.lustre.0 Request processed in 126us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782975.092049:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787782975.092375:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922433024:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782975.092389:0:15010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3140cc7000/0x6d98ed19b6381aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6381b1 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782975.092397:0:15010:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3140cc7000/0x6d98ed19b6381aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b6381b1 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787782975.092901:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787782975.094320:0:15010:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782975.094604:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787782975.094641:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787782975.094691:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787782975.094699:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787782975.094782:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922433152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782975.094844:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782975.094888:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107f22600 going to sleep for 11 seconds 00000100:00100000:3.0:1787782975.095080:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922433152 00000100:00100000:3.0:1787782975.095087:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922433152 00000100:00100000:3.0:1787782975.095157:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787782975.095167:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+15:15010:x1874625922433152:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782975.095389:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+15:15010:x1874625922433152:12345-0@lo:501:mount.lustre.0 Request processed in 223us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782975.095397:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787782975.099621:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922433152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782975.099718:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922433280:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787782975.099801:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782975.099838:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107f22600 going to sleep for 11 seconds 00000100:00100000:3.0:1787782975.100795:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922433280 00000100:00100000:3.0:1787782975.100806:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922433280 00000100:00100000:3.0:1787782975.100860:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787782975.100870:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+15:15010:x1874625922433280:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782975.101161:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+15:15010:x1874625922433280:12345-0@lo:503:mount.lustre.0 Request processed in 292us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782975.101170:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787782975.101473:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922433280:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787782975.109284:0:15010:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787782975.109380:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922433408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782975.109461:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782975.109510:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c311f9be180 going to sleep for 11 seconds 00000100:00100000:2.0:1787782975.109755:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922433408 00000100:00100000:2.0:1787782975.109762:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922433408 00000100:00100000:2.0:1787782975.109809:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787782975.109818:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+15:15010:x1874625922433408:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782975.110054:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+15:15010:x1874625922433408:12345-0@lo:502:mount.lustre.0 Request processed in 237us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782975.110063:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787782975.111299:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922433408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787782975.111614:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787782975.111675:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787782975.111728:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787782975.111766:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787782975.111796:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787782975.111842:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787782975.111877:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787782975.111907:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787782975.111945:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922433536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782975.112026:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782975.112073:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107f22600 going to sleep for 11 seconds 00000100:00100000:2.0:1787782975.112402:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922433536 00000100:00100000:2.0:1787782975.112410:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922433536 00000100:00100000:2.0:1787782975.112458:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787782975.112467:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+15:15010:x1874625922433536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782975.112667:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+15:15010:x1874625922433536:12345-0@lo:502:mount.lustre.0 Request processed in 200us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782975.112675:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787782975.114230:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922433536:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787782975.114398:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787782975.114413:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787782975.116872:0:15028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782975.116886:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782975.116888:0:15028:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787782975.117371:0:15028:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c3107128000 00000020:00000080:1.0:1787782975.117375:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787782975.117383:0:15028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782975.117385:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782975.117387:0:15028:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787782975.117390:0:15028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782975.117392:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782975.117394:0:15028:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787782975.117397:0:15028:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c3107128000 00000020:00000080:1.0:1787782975.117398:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787782975.125133:0:15028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782975.125185:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782975.125187:0:15028:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787782975.125191:0:15028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787782975.125196:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782975.125197:0:15028:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787782975.125202:0:15028:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c3107128000 00000020:00000080:1.0:1787782975.125205:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787782975.125312:0:15028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787782975.125316:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787782975.125317:0:15028:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787782975.125320:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787782975.127287:0:15010:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787782975.127328:0:15010:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787782975.127352:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3140cc7000/0x6d98ed19b6381aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6381b1 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.127365:0:15010:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3140cc7000/0x6d98ed19b6381aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6381b1 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782975.127437:0:15010:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787782975.127440:0:15010:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c3107128000 10000000:01000000:2.0:1787782975.127444:0:15010:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c3107128000 10000000:01000000:2.0:1787782975.127448:0:15010:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787782975.127454:0:15010:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c3107128000 from 1 10000000:01000000:2.0:1787782975.127457:0:15010:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787782975.127496:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141205c00/0x6d98ed19b6381b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.127505:0:15010:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141205c00/0x6d98ed19b6381b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.127516:0:15010:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141205c00/0x6d98ed19b6381b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782975.127542:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922433664:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787782975.127612:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782975.127657:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31061e0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787782975.127879:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922433664 00000100:00100000:1.0:1787782975.127887:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922433664 00000100:00100000:1.0:1787782975.127944:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787782975.127976:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+15:15010:x1874625922433664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782975.127991:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782975.128005:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3140cc7800/0x6d98ed19b6381bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b6381b8 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782975.128029:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3140cc7800/0x6d98ed19b6381bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b6381b8 expref: 16 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782975.128054:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3140cc7800/0x6d98ed19b6381bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6381b8 expref: 16 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782975.128063:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3140cc7800, rc 0) 00000100:00100000:1.0:1787782975.128119:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+16:15010:x1874625922433664:12345-0@lo:101:mount.lustre.0 Request processed in 155us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782975.128126:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787782975.130348:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922433664:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782975.130378:0:15010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141205c00/0x6d98ed19b6381b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6381bf expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.130390:0:15010:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141205c00/0x6d98ed19b6381b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b6381bf expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787782975.133154:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787782975.133596:0:15010:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787782975.133870:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787782975.133923:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787782975.133958:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787782975.134031:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787782975.134073:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787782975.134153:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787782975.134194:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787782975.134230:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787782975.134277:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787782975.134316:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787782975.134353:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787782975.134401:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787782975.134438:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787782975.134494:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787782975.134540:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787782975.134574:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787782975.134604:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787782975.134648:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787782975.134684:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787782975.134719:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787782975.134765:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787782975.134803:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787782975.134837:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787782975.134886:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787782975.134924:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787782975.134958:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787782975.135018:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787782975.135052:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787782975.135161:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787782975.135169:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787782975.135265:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922433792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782975.135336:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782975.139505:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31061e0840 going to sleep for 11 seconds 00000100:00100000:0.0:1787782975.142269:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922433792 00000100:00100000:0.0:1787782975.142283:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922433792 00000100:00100000:0.0:1787782975.142354:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787782975.142365:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+16:15010:x1874625922433792:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782975.143402:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+16:15010:x1874625922433792:12345-0@lo:501:mount.lustre.0 Request processed in 1034us (8062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782975.143413:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787782975.143611:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922433792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782975.143663:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cca92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922433920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782975.143715:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782975.143754:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31052b1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787782975.144073:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922433920 00000100:00100000:2.0:1787782975.144080:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922433920 00000100:00100000:0.0:1787782975.144330:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787782975.144340:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+16:15010:x1874625922433920:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787782975.144509:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+16:15010:x1874625922433920:12345-0@lo:503:mount.lustre.0 Request processed in 170us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782975.144517:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787782975.146333:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cca92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922433920:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787782975.146925:0:15010:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787782975.148385:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cca92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922434048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782975.148465:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782975.149342:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922434048 00000100:00100000:0.0:1787782975.149352:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922434048 00000100:00100000:0.0:1787782975.149406:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787782975.149416:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+16:15010:x1874625922434048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782975.149879:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102d0cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782975.152359:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+16:15010:x1874625922434048:12345-0@lo:502:mount.lustre.0 Request processed in 2937us (3886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782975.152372:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787782975.153269:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cca92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922434048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787782975.153549:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787782975.153609:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787782975.153644:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787782975.153692:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787782975.153728:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787782975.153776:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787782975.153809:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787782975.153844:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787782975.153896:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787782975.157283:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787782975.157332:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787782975.157408:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787782975.157446:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787782975.157495:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787782975.157566:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787782975.157604:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787782975.157638:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787782975.157685:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787782975.157721:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787782975.157754:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787782975.157820:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787782975.157860:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787782975.157891:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787782975.162259:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787782975.162374:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787782975.162414:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787782975.162474:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787782975.162514:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787782975.162551:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787782975.162602:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787782975.162666:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787782975.162702:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787782975.162737:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787782975.162787:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787782975.162825:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787782975.162872:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787782975.162908:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787782975.162941:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787782975.166416:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787782975.166460:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787782975.166515:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cca92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922434176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782975.166600:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782975.166703:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31052b1480 going to sleep for 11 seconds 00000100:00100000:2.0:1787782975.175772:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922434176 00000100:00100000:2.0:1787782975.175787:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922434176 00000100:00100000:2.0:1787782975.175853:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787782975.175863:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+16:15010:x1874625922434176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782975.176666:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+16:15010:x1874625922434176:12345-0@lo:502:mount.lustre.0 Request processed in 802us (10064us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782975.176676:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787782975.184721:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cca92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922434176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787782975.189015:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787782975.189035:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787782975.191423:0:15033:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787782975.191474:0:15033:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8c311841cd28) 00000020:00000080:0.0:1787782975.191497:0:15033:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787782975.191595:0:15033:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c3107128000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787782975.191600:0:15033:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c3107128000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787782975.191603:0:15033:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c3107128000 3 00010000:00080000:0.0:1787782975.191635:0:15033:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c31091da800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.115@tcp at head 00010000:00010000:1.0:1787782975.193885:0:15033:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1787782975.194812:0:15033:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787782975.194855:0:15033:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787782975.194867:0:15033:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x6d98ed19b6381cd 00000100:00080000:1.0:1787782975.194878:0:15033:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787782975.194884:0:15033:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c31091da800 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787782975.195000:0:15033:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c31411d2d00 x1874625922434304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787782975.195030:0:15033:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787782975.195161:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625922434304:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787782975.195244:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782975.195420:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922434304 00000100:00100000:1.0:1787782975.195438:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922434304 00000100:00100000:1.0:1787782975.195476:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787782975.195483:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874625922434304:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787782975.195508:0:14330:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:1.0:1787782975.195550:0:14330:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x6d98ed19b6381d4 00000004:00100000:1.0:1787782975.195566:0:14330:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787782975.195596:0:14330:0:(import.c:65:import_set_state_nolock()) ffff8c3110777000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787782975.195654:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874625922434304:12345-0@lo:38:llog_process_th.0 Request processed in 170us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782975.195672:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787782975.195714:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c31411d2d00 x1874625922434304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787782985 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782975.195724:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787782975.195732:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787782975.195739:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787782975.195743:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787782975.195745:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c31091da800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787782975.195751:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874625922434304:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787782975.203316:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782975.203327:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787782975.203330:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782975.203333:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787782975.203419:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922434432:0@lo:400:kworker.0 00000100:00100000:1.0:1787782975.203489:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782975.207052:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922434432 00000100:00100000:2.0:1787782975.207067:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922434432 00000100:00100000:2.0:1787782975.207149:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787782975.207160:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922434432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787782975.209582:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922434432:12345-0@lo:400:kworker.0 Request processed in 2417us (6085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782975.209597:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:2.0:1787782975.209786:0:15033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1787782975.215253:0:15010:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787782975.215299:0:15010:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787782975.215326:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141205c00/0x6d98ed19b6381b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6381bf expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.215338:0:15010:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141205c00/0x6d98ed19b6381b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6381bf expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787782975.215415:0:15010:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787782975.215417:0:15010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787782975.215419:0:15010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787782975.215420:0:15010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787782975.215422:0:15010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787782975.215423:0:15010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787782975.215424:0:15010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787782975.215426:0:15010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787782975.215435:0:15010:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787782975.215439:0:15010:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787782975.215441:0:15010:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787782975.215450:0:15010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787782975.215451:0:15010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787782975.215452:0:15010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787782975.215453:0:15010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787782975.215454:0:15010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787782975.215455:0:15010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787782975.215456:0:15010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787782975.215457:0:15010:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787782975.215486:0:15010:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787782975.215507:0:15010:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922434560:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787782975.215593:0:15010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782975.215634:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922434560 00000100:00100000:0.0:1787782975.215641:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922434560 00000100:00100000:0.0:1787782975.215687:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787782975.215695:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+16:15010:x1874625922434560:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787782975.215719:0:14325:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787782975.215732:0:14325:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1787782975.216407:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c31346fc780 x1874625922434432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782975.216423:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922434432:0@lo:400:kworker.0 00000100:00100000:1.0:1787782975.217314:0:15010:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c310911c180 going to sleep for 11 seconds 20000000:01000000:0.0:1787782975.258257:0:14325:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787782975.258268:0:14325:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787782975.258336:0:14346:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787782975.258342:0:14346:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787782975.258367:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.258388:0:14346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3140cc6a00/0x6d98ed19b638148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b638141 expref: 16 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.258423:0:14346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.258463:0:14346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3140cc6a00/0x6d98ed19b638148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b638141 expref: 16 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.258477:0:14346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c3140cc6a00/0x6d98ed19b638148 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b638141 expref: 16 pid: 14323 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782975.258490:0:14346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fcb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14346:1874625922434688:0@lo:104: 00000100:00100000:2.0:1787782975.258555:0:14346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782975.258604:0:14346:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31184d9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787782975.259534:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922434688 00000100:00100000:0.0:1787782975.259544:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922434688 00000100:00100000:0.0:1787782975.259598:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782975.259609:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c63e6d-1dfe-4772-affc-638938210ba4+3:14346:x1874625922434688:12345-0@lo:104: 00010000:00010000:0.0:1787782975.259622:0:14313:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c3141254e00/0x6d98ed19b638141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b638148 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.259692:0:14313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787782975.259698:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c63e6d-1dfe-4772-affc-638938210ba4+3:14346:x1874625922434688:12345-0@lo:104: Request processed in 91us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782975.259705:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787782975.259727:0:14319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782975.259733:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3141254e00/0x6d98ed19b638141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b638148 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.259750:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254e00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:0.0:1787782975.259755:0:14319:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3141254e00/0x6d98ed19b638141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b638148 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.259763:0:14319:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3141254e00/0x6d98ed19b638141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b638148 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787782975.259770:0:14319:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3141254e00/0x6d98ed19b638141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b638148 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787782975.259776:0:14319:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787782975.259811:0:14319:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3141254e00/0x6d98ed19b638141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b638148 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.259818:0:14319:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787782975.259838:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3141254e00/0x6d98ed19b638141 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b638148 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.259845:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3141254e00/0x6d98ed19b638141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b638148 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.259860:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782975.259862:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782975.259864:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787782975.259887:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c63e6d-1dfe-4772-affc-638938210ba4:3304:1874625922434816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787782975.260033:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782975.260252:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922434816 00000100:00100000:0.0:1787782975.260257:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922434816 00010000:00010000:0.0:1787782975.260284:0:14317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3140cc6a00/0x6d98ed19b638148 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b638141 expref: 17 pid: 14323 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782975.260322:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787782975.260337:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c63e6d-1dfe-4772-affc-638938210ba4+17:3304:x1874625922434816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787782975.260348:0:14317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787782975.260353:0:14317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3140cc6a00/0x6d98ed19b638148 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b638141 expref: 17 pid: 14323 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.260371:0:14317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3140cc6a00/0x6d98ed19b638148 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b638141 expref: 17 pid: 14323 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.260395:0:14317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261075:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.261296:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3140cc6a00/0x6d98ed19b638148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b638141 expref: 17 pid: 14323 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782975.261310:0:14346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fcb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14346:1874625922434688:0@lo:104: 00010000:00010000:2.0:1787782975.261337:0:14346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.261347:0:14346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.261360:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787782975.261368:0:14346:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787782975.261372:0:14346:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787782975.261391:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c3141204600/0x6d98ed19b6381e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.261433:0:14346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.261446:0:14346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c3141204600/0x6d98ed19b6381e2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.261463:0:14346:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.261477:0:14346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c3141204600/0x6d98ed19b6381e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787782975.261558:0:14317:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002641823s 00010000:00010000:0.0:1787782975.261564:0:14317:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261571:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261577:0:14317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261585:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261591:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204400 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782975.261601:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261609:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261620:0:14317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c3141204600/0x6d98ed19b6381e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261627:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141204600/0x6d98ed19b6381e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787782975.261637:0:14317:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002641823s 00010000:00010000:0.0:1787782975.261641:0:14317:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3141204600/0x6d98ed19b6381e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261647:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3141204600/0x6d98ed19b6381e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261654:0:14317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c3141204600/0x6d98ed19b6381e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261659:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c3141204600/0x6d98ed19b6381e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261665:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204600 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782975.261668:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c3141204600/0x6d98ed19b6381e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261675:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c3141204600/0x6d98ed19b6381e2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261696:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c3141204600/0x6d98ed19b6381e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261713:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261720:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3141204400/0x6d98ed19b6381db lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782975.261731:0:14317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787782975.261797:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c63e6d-1dfe-4772-affc-638938210ba4+16:3304:x1874625922434816:12345-0@lo:103:ldlm_bl.0 Request processed in 1467us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782975.261807:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787782975.261950:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c63e6d-1dfe-4772-affc-638938210ba4:3304:1874625922434816:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787782975.262284:0:14346:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c3141204600/0x6d98ed19b6381e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.262293:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c3141204600/0x6d98ed19b6381e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782975.262300:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3141204600/0x6d98ed19b6381e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782975.280734:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+15:15010:x1874625922434560:12345-0@lo:253:mount.lustre.0 Request processed in 65031us (65133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782975.280749:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787782975.280874:0:15010:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15010:1874625922434560:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787782975.280890:0:15010:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787782975.280893:0:15010:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787782975.280906:0:15010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787782975.280907:0:15010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782975.280908:0:15010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782975.280910:0:15010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782975.280911:0:15010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782975.280913:0:15010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782975.280914:0:15010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782975.280925:0:15010:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787782975.281311:0:15010:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787782975.297883:0:15010:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787782975.298073:0:15010:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787782975.298395:0:15010:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787782975.298549:0:15010:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787782975.298708:0:15010:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787782975.299379:0:15010:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787782975.300808:0:15010:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787782975.363013:0:15010:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787782975.363023:0:15010:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787782975.363058:0:15010:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787782975.363211:0:15010:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787782975.363231:0:15010:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787782975.363257:0:15010:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787782975.905581:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787782976.684294:0:14327:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787782976.684302:0:14327:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c3129e3b800 from 7 10000000:01000000:3.0:1787782976.684307:0:14327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787782976.684358:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0a00/0x6d98ed19b6381e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782976.684370:0:14327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c31013a0a00/0x6d98ed19b6381e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782976.684382:0:14327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c31013a0a00/0x6d98ed19b6381e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782976.684408:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cca92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922434944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787782976.684479:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782976.684579:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31346dd900 going to sleep for 11 seconds 00000100:00100000:2.0:1787782976.689322:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922434944 00000100:00100000:2.0:1787782976.689335:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922434944 00000100:00100000:2.0:1787782976.689394:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787782976.689405:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+15:14327:x1874625922434944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782976.689422:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782976.689444:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141204a00/0x6d98ed19b6381f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b6381e9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782976.689473:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141204a00/0x6d98ed19b6381f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b6381e9 expref: 16 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782976.689484:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141204a00/0x6d98ed19b6381f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6381e9 expref: 16 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782976.689492:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204a00, rc 0) 00000100:00100000:2.0:1787782976.689573:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+16:14327:x1874625922434944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (5094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782976.689581:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787782976.689639:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cca92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922434944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787782976.689657:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c31013a0a00/0x6d98ed19b6381e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6381f0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782976.689667:0:14327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c31013a0a00/0x6d98ed19b6381e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b6381f0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782976.689740:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922435072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787782976.689785:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782976.689823:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31184d9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787782976.690029:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922435072 00000100:00100000:0.0:1787782976.690035:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922435072 00000100:00100000:0.0:1787782976.690071:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787782976.690079:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+16:14327:x1874625922435072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787782976.690117:0:14323:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787782976.690136:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787782976.690139:0:14323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787782976.690223:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+16:14327:x1874625922435072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782976.690231:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787782976.690309:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fcb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922435072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787782976.690366:0:14327:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787782976.690374:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c31013a0a00/0x6d98ed19b6381e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6381f0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782976.690392:0:14327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c31013a0a00/0x6d98ed19b6381e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6381f0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782976.929247:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782977.957997:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782978.977277:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782980.001391:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787782980.707124:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782980.707131:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787782980.707133:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787782980.707136:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787782980.707186:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922435328:0@lo:400:kworker.0 00000100:00100000:2.0:1787782980.707260:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782980.707321:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787782980.707327:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922435456:0@lo:400:kworker.0 00000100:00100000:2.0:1787782980.707353:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782980.707506:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c63e6d-1dfe-4772-affc-638938210ba4:3305:1874625922435200:0@lo:400:kworker.0 00000100:00100000:3.0:1787782980.707543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782980.707585:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922435200 00000100:00100000:3.0:1787782980.707593:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922435200 00000100:00100000:3.0:1787782980.707635:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787782980.707645:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+16:3305:x1874625922435200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782980.707693:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+16:3305:x1874625922435200:12345-0@lo:400:kworker.0 Request processed in 50us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782980.707700:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787782980.707746:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c63e6d-1dfe-4772-affc-638938210ba4:3305:1874625922435200:0@lo:400:kworker.0 00000100:00100000:1.0:1787782980.708522:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922435328 00000100:00100000:1.0:1787782980.708529:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922435328 00000100:00100000:1.0:1787782980.708561:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922435456 00000100:00100000:1.0:1787782980.708564:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922435456 00000100:00100000:1.0:1787782980.708591:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787782980.708599:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922435328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782980.708688:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922435328:12345-0@lo:400:kworker.0 Request processed in 90us (1427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782980.708695:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787782980.708709:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787782980.708715:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922435456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782980.708741:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922435456:12345-0@lo:400:kworker.0 Request processed in 27us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782980.708746:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787782980.708793:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787782980.708843:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c31346fc000 x1874625922435456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782980.708855:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922435456:0@lo:400:kworker.0 00010000:00080000:1.0:1787782980.708866:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c31346ff840 x1874625922435328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787782996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782980.708875:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346ff840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922435328:0@lo:400:kworker.0 00010000:00010000:1.0:1787782981.027000:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782982.049998:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787782982.378975:0:14364:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1787782982.770814:0:15380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787782983.080606:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782984.097507:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782985.123398:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782985.441499:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782970/real 1787782970] req@ffff8c31411d1680 x1874625922431232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782985 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782985.441534:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c31411d1680 x1874625922431232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782985 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782985.441546:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787782970/real 1787782970] req@ffff8c31411d0000 x1874625922431360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782985 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782985.441557:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c31411d0000 x1874625922431360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787782985 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787782985.441574:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c3132180000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782985.441667:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787782985.441671:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922431232:0@lo:8:kworker.0 00000100:00080000:2.0:1787782985.441678:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c3001e17000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787782985.445836:0:13877:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782985.445843:0:13877:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787782985.445847:0:13877:0:(import.c:65:import_set_state_nolock()) ffff8c3132180000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787782985.445855:0:13877:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:1.0:1787782985.445860:0:13877:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787782985.445869:0:13877:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c3132180000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787782985.445917:0:13877:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c31411d3c00 x1874625922435712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787782985.445931:0:13877:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782985.445935:0:13877:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787782985.445937:0:13877:0:(import.c:65:import_set_state_nolock()) ffff8c3001e17000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787782985.445940:0:13877:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 455 00000100:00080000:1.0:1787782985.445942:0:13877:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787782985.445956:0:13877:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c3001e17000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787782985.445968:0:13877:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c31411d2940 x1874625922435840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787782985.446029:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922436096:0@lo:400:kworker.0 00000100:00100000:1.0:1787782985.446122:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782985.446204:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922436096 00000100:00100000:1.0:1787782985.446211:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922436096 00000100:00100000:3.0:1787782985.446370:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c63e6d-1dfe-4772-affc-638938210ba4:3304:1874625922435584:0@lo:400:kworker.0 00000100:00100000:3.0:1787782985.446406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782985.446433:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787782985.446439:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625922435968:0@lo:400:kworker.0 00000100:00100000:3.0:1787782985.446464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782985.446504:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922435584 00000100:00100000:3.0:1787782985.446508:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922435584 00000100:00100000:3.0:1787782985.446547:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787782985.446556:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+16:3304:x1874625922435584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782985.446600:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+16:3304:x1874625922435584:12345-0@lo:400:kworker.0 Request processed in 45us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782985.446616:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787782985.446648:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922435968 00000100:00100000:3.0:1787782985.446652:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922435968 00000100:00100000:3.0:1787782985.446677:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787782985.446684:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cca83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625922435968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782985.446717:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cca83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874625922435968:12345-0@lo:400:kworker.0 Request processed in 33us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782985.446723:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787782985.446760:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c31411d0f00 x1874625922435968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787783001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782985.446773:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874625922435968:0@lo:400:kworker.0 00000100:00100000:3.0:1787782985.446782:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c63e6d-1dfe-4772-affc-638938210ba4:3304:1874625922435584:0@lo:400:kworker.0 00000100:00100000:1.0:1787782985.447297:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787782985.447306:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922436096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782985.447352:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922436096:12345-0@lo:400:kworker.0 Request processed in 48us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782985.447358:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787782985.447388:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c31411d0b40 x1874625922436096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787783001 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782985.447398:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922436096:0@lo:400:kworker.0 00000100:00080000:0.0:1787782985.448606:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787782985.451735:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787782985.451745:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922431360:0@lo:8:kworker.0 00000100:00100000:2.0:1787782985.451791:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922435712:0@lo:8:kworker.0 00000100:00100000:2.0:1787782985.451867:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782985.451928:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922435840:0@lo:8:kworker.0 00000100:00100000:3.0:1787782985.452072:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922435712 00000100:00100000:3.0:1787782985.452080:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922435712 00000100:00100000:3.0:1787782985.452136:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787782985.452143:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1874625922435712:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787782985.452173:0:15012:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:3.0:1787782985.452205:0:15012:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d98ed19b6381f7 00002000:00100000:3.0:1787782985.452392:0:15012:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c313cc3c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113937 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787782985.452398:0:15012:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787782985.452401:0:15012:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787782985.453405:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782985.454136:0:15014:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787782985.454145:0:15014:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787782985.455265:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922435840 00000100:00100000:1.0:1787782985.455288:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922435840 00000100:00100000:2.0:1787782985.455459:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787782985.455468:0:15495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3303:x1874625922435840:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787782985.455489:0:15495:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787782985.455566:0:15495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3303:x1874625922435840:12345-0@lo:8:kworker.0 Request processed in 97us (2163us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787782985.455574:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787782985.455612:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c3001e17000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787782985.455617:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787782985.455622:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922435840:0@lo:8:kworker.0 00002000:00080000:3.0:1787782985.455727:0:15012:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787782985.455756:0:15012:0:(import.c:65:import_set_state_nolock()) ffff8c313cc3b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787782985.455806:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874625922435712:12345-0@lo:8:kworker.0 Request processed in 3662us (3939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782985.455820:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787782985.456661:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c31411d3c00 x1874625922435712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787783005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782985.456673:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787782985.456681:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787782985.456689:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787782985.456695:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787782985.456707:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c3132180000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787782985.456726:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787782985.456732:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922435712:0@lo:8:kworker.0 00000004:00080000:1.0:1787782985.456841:0:14353:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1787782985.456862:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d1a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14353:1874625922436352:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787782985.456918:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782985.456943:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31346c5480 going to sleep for 11 seconds 00000100:00100000:1.0:1787782985.456974:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922436352 00000100:00100000:1.0:1787782985.456979:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922436352 00000100:00100000:1.0:1787782985.457018:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787782985.457025:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14353:x1874625922436352:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787782985.465187:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922436224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787782985.465261:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787782985.465346:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787782985.465869:0:14352:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787782985.466314:0:14352:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 470136217190ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787782985.466365:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922436224 00000100:00100000:0.0:1787782985.466374:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922436224 00000100:00100000:0.0:1787782985.466416:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787782985.466425:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874625922436224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787782985.466458:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787782985.466524:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874625922436224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782985.466536:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787782985.466580:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c31411d0b40 x1874625922436224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787783001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787782985.466599:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922436224:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1787782985.470730:0:15013:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787782985.470743:0:15013:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787782985.470749:0:15013:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1787782985.488764:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.488778:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b6381fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.488795:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.488800:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.488807:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b6381fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.488827:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b6381fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.488838:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b6381fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.488846:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b6381fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.488885:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782985.488899:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782985.488905:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b6381fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.488912:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7200 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782985.488917:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b6381fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.488925:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b6381fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.488941:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b6381fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.488949:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078ed4ec0/0x6d98ed19b6381fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.488966:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782985.488969:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782985.488971:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787782985.489475:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.489482:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e2a38a/0x6d98ed19b638205 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.489491:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.489501:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.489506:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e2a38a/0x6d98ed19b638205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.489517:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5e2a38a/0x6d98ed19b638205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.489526:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5e2a38a/0x6d98ed19b638205 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.489533:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5e2a38a/0x6d98ed19b638205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.489546:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782985.491732:0:14319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782985.491745:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5e2a38a/0x6d98ed19b638205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.491758:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6a00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787782985.491763:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e2a38a/0x6d98ed19b638205 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.491773:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5e2a38a/0x6d98ed19b638205 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.491795:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5e2a38a/0x6d98ed19b638205 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.491803:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5e2a38a/0x6d98ed19b638205 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.491834:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782985.491836:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782985.491837:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787782985.493955:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.493966:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076426223/0x6d98ed19b63820c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.493979:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.493983:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.493988:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076426223/0x6d98ed19b63820c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.493998:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076426223/0x6d98ed19b63820c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.494004:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076426223/0x6d98ed19b63820c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.494018:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076426223/0x6d98ed19b63820c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.494034:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782985.494059:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782985.494071:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076426223/0x6d98ed19b63820c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.494079:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6e00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787782985.494083:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076426223/0x6d98ed19b63820c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.494091:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076426223/0x6d98ed19b63820c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787782985.494562:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.494568:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b638213 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.494577:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.494580:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.494584:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b638213 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.494592:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b638213 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.494600:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b638213 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.494607:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b638213 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.494627:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076426223/0x6d98ed19b63820c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.494632:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782985.494635:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076426223/0x6d98ed19b63820c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.494654:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782985.494657:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b638213 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.494664:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7c00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787782985.494667:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b638213 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.494675:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b638213 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.494696:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b638213 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.494704:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd1085bb/0x6d98ed19b638213 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.494715:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782985.494717:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782985.494719:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782985.494762:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787782985.494996:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787782985.496268:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.496278:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000940f700a/0x6d98ed19b63821a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.496298:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.496301:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.496307:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000940f700a/0x6d98ed19b63821a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.496318:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000940f700a/0x6d98ed19b63821a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.496326:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000940f700a/0x6d98ed19b63821a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.496334:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000940f700a/0x6d98ed19b63821a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.496353:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787782985.496905:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782985.496913:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000940f700a/0x6d98ed19b63821a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.496922:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6000 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787782985.496926:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000940f700a/0x6d98ed19b63821a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.496934:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000940f700a/0x6d98ed19b63821a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.496950:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000940f700a/0x6d98ed19b63821a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.496958:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000940f700a/0x6d98ed19b63821a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.496989:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782985.496991:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782985.496993:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787782985.499294:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.499306:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b638221 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.499323:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.499327:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.499332:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b638221 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.499345:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b638221 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.499370:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b638221 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.499376:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b638221 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.499434:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787782985.499953:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.499958:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b638228 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.499965:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.499967:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.499970:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b638228 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.499976:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b638228 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.499981:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b638228 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.499986:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b638228 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.500420:0:14319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787782985.500429:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b638221 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.500438:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7400 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787782985.500442:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b638221 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.500451:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b638221 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.500474:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b638221 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.500481:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed02fb0c/0x6d98ed19b638221 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.500502:0:14319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782985.500506:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b638228 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.500512:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7e00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787782985.500516:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b638228 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.500531:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b638228 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.500541:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b638228 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.500548:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782985.500550:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782985.500552:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782985.500942:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787782985.500949:0:15013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091db47dd/0x6d98ed19b638228 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787782985.501467:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.501475:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031d04810/0x6d98ed19b63822f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.501607:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782985.501689:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.501694:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.501702:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031d04810/0x6d98ed19b63822f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.501714:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031d04810/0x6d98ed19b63822f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.501723:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031d04810/0x6d98ed19b63822f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.501730:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031d04810/0x6d98ed19b63822f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.501756:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787782985.501833:0:14319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782985.501840:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031d04810/0x6d98ed19b63822f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.501848:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7a00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787782985.501852:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031d04810/0x6d98ed19b63822f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.501860:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031d04810/0x6d98ed19b63822f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.501886:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031d04810/0x6d98ed19b63822f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.501894:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031d04810/0x6d98ed19b63822f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.501922:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782985.501924:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782985.501926:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787782985.502670:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.502678:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001811a586/0x6d98ed19b638236 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.502696:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.502700:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.502705:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001811a586/0x6d98ed19b638236 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.502715:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001811a586/0x6d98ed19b638236 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.502723:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001811a586/0x6d98ed19b638236 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.502730:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001811a586/0x6d98ed19b638236 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.502790:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787782985.503259:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.503265:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092ec0701/0x6d98ed19b63823d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.503273:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.503277:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.503281:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092ec0701/0x6d98ed19b63823d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.503291:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092ec0701/0x6d98ed19b63823d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.503310:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092ec0701/0x6d98ed19b63823d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.503318:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092ec0701/0x6d98ed19b63823d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.503691:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787782985.503700:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001811a586/0x6d98ed19b638236 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.503708:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6400 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787782985.503712:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001811a586/0x6d98ed19b638236 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.503722:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001811a586/0x6d98ed19b638236 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.503738:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001811a586/0x6d98ed19b638236 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.503745:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001811a586/0x6d98ed19b638236 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.503765:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787782985.503768:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092ec0701/0x6d98ed19b63823d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.503775:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6800 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787782985.503786:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ec0701/0x6d98ed19b63823d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.503795:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ec0701/0x6d98ed19b63823d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.503816:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092ec0701/0x6d98ed19b63823d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.503826:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782985.503827:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787782985.503829:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782985.503918:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787782985.503924:0:15013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092ec0701/0x6d98ed19b63823d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.504006:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787782985.504615:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.504623:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b638244 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.504634:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.504638:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.504643:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b638244 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.504653:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b638244 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.504661:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b638244 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.504683:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b638244 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.504738:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787782985.505180:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.505187:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2559434/0x6d98ed19b63824b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.505196:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.505199:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.505203:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2559434/0x6d98ed19b63824b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.505211:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2559434/0x6d98ed19b63824b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.505219:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2559434/0x6d98ed19b63824b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.505226:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2559434/0x6d98ed19b63824b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.505430:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787782985.505438:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b638244 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.505446:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc6c00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787782985.505450:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b638244 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.505458:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b638244 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.505474:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b638244 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782985.505481:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005d20a86/0x6d98ed19b638244 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.505584:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787782985.505738:0:14319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782985.505745:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2559434/0x6d98ed19b63824b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.505753:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7600 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787782985.505756:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2559434/0x6d98ed19b63824b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.505764:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2559434/0x6d98ed19b63824b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.505776:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2559434/0x6d98ed19b63824b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.505782:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2559434/0x6d98ed19b63824b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.505797:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782985.505799:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782985.505801:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787782985.506062:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.506068:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047b93993/0x6d98ed19b638252 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.506084:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.506088:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.506157:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047b93993/0x6d98ed19b638252 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.506170:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047b93993/0x6d98ed19b638252 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.506179:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047b93993/0x6d98ed19b638252 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.506186:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047b93993/0x6d98ed19b638252 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.506207:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787782985.506563:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.506569:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005adb5e85/0x6d98ed19b638259 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.506577:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.506579:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.506584:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005adb5e85/0x6d98ed19b638259 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.506591:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005adb5e85/0x6d98ed19b638259 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.506609:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005adb5e85/0x6d98ed19b638259 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.506616:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005adb5e85/0x6d98ed19b638259 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.506624:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787782985.506804:0:14319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787782985.506810:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047b93993/0x6d98ed19b638252 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.506833:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fc000 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787782985.506837:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047b93993/0x6d98ed19b638252 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.506845:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047b93993/0x6d98ed19b638252 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.506860:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047b93993/0x6d98ed19b638252 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.506868:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047b93993/0x6d98ed19b638252 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.506897:0:14319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782985.506901:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005adb5e85/0x6d98ed19b638259 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.506908:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fcc00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782985.506910:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782985.506911:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005adb5e85/0x6d98ed19b638259 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.506913:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782985.506915:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782985.506918:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005adb5e85/0x6d98ed19b638259 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.506927:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005adb5e85/0x6d98ed19b638259 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.506941:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005adb5e85/0x6d98ed19b638259 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.506954:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782985.506956:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782985.506958:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787782985.507215:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.507221:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051e5efc6/0x6d98ed19b638260 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.507229:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.507232:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.507236:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051e5efc6/0x6d98ed19b638260 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.507244:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051e5efc6/0x6d98ed19b638260 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.507251:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051e5efc6/0x6d98ed19b638260 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.507256:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051e5efc6/0x6d98ed19b638260 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.507314:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787782985.507683:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.507688:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5e82f66/0x6d98ed19b638267 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.507697:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.507700:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.507704:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e82f66/0x6d98ed19b638267 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.507713:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5e82f66/0x6d98ed19b638267 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.507722:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5e82f66/0x6d98ed19b638267 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.507729:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5e82f66/0x6d98ed19b638267 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.507790:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787782985.507797:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051e5efc6/0x6d98ed19b638260 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.507815:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fd400 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782985.507819:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051e5efc6/0x6d98ed19b638260 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.507840:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051e5efc6/0x6d98ed19b638260 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.507856:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051e5efc6/0x6d98ed19b638260 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.507865:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051e5efc6/0x6d98ed19b638260 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.507892:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782985.507895:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5e82f66/0x6d98ed19b638267 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.507902:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fde00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782985.507905:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5e82f66/0x6d98ed19b638267 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.507912:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5e82f66/0x6d98ed19b638267 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.507923:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5e82f66/0x6d98ed19b638267 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.507930:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782985.507932:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782985.507940:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782985.508031:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787782985.508036:0:15013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5e82f66/0x6d98ed19b638267 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.508131:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787782985.508571:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.508578:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e7cae0f/0x6d98ed19b63826e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.508592:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.508595:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.508600:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e7cae0f/0x6d98ed19b63826e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.508610:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e7cae0f/0x6d98ed19b63826e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.508618:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e7cae0f/0x6d98ed19b63826e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.508625:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e7cae0f/0x6d98ed19b63826e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.508682:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787782985.509158:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.509164:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd65433/0x6d98ed19b638275 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.509173:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.509176:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.509181:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007cd65433/0x6d98ed19b638275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.509190:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007cd65433/0x6d98ed19b638275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.509209:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007cd65433/0x6d98ed19b638275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.509217:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007cd65433/0x6d98ed19b638275 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.513479:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787782985.514177:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.514186:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c216826/0x6d98ed19b63827c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.514204:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.514209:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.514215:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c216826/0x6d98ed19b63827c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.514229:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c216826/0x6d98ed19b63827c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.514239:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c216826/0x6d98ed19b63827c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.514247:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c216826/0x6d98ed19b63827c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.514271:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787782985.514681:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.514687:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087341127/0x6d98ed19b638283 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.514697:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.514700:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.514705:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087341127/0x6d98ed19b638283 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.514713:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087341127/0x6d98ed19b638283 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.514721:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087341127/0x6d98ed19b638283 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.514729:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087341127/0x6d98ed19b638283 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.514737:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787782985.515165:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.515171:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077631e58/0x6d98ed19b63828a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.515181:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.515193:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.515198:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077631e58/0x6d98ed19b63828a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.515208:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077631e58/0x6d98ed19b63828a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.515218:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077631e58/0x6d98ed19b63828a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.515225:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077631e58/0x6d98ed19b63828a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.515232:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787782985.515602:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.515608:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000407bc855/0x6d98ed19b638291 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.515616:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.515619:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.515624:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000407bc855/0x6d98ed19b638291 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.515633:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000407bc855/0x6d98ed19b638291 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.515641:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000407bc855/0x6d98ed19b638291 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.515654:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000407bc855/0x6d98ed19b638291 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.515662:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1787782985.516024:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.516030:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000771be891/0x6d98ed19b638298 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.516038:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.516041:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.516045:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000771be891/0x6d98ed19b638298 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.516053:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000771be891/0x6d98ed19b638298 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.516060:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000771be891/0x6d98ed19b638298 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.516067:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000771be891/0x6d98ed19b638298 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.516075:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1787782985.516469:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.516475:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058a034f9/0x6d98ed19b63829f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.516488:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.516491:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.516495:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058a034f9/0x6d98ed19b63829f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.516504:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058a034f9/0x6d98ed19b63829f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.516512:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000058a034f9/0x6d98ed19b63829f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.516520:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058a034f9/0x6d98ed19b63829f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.516527:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1787782985.517331:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1787782985.517340:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e7cae0f/0x6d98ed19b63826e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517349:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fd000 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782985.517354:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e7cae0f/0x6d98ed19b63826e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517363:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e7cae0f/0x6d98ed19b63826e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517381:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e7cae0f/0x6d98ed19b63826e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517389:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e7cae0f/0x6d98ed19b63826e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517412:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787782985.517416:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007cd65433/0x6d98ed19b638275 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517422:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fda00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782985.517425:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd65433/0x6d98ed19b638275 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517433:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007cd65433/0x6d98ed19b638275 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517452:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007cd65433/0x6d98ed19b638275 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517459:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007cd65433/0x6d98ed19b638275 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517473:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787782985.517477:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c216826/0x6d98ed19b63827c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517494:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fd800 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782985.517498:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c216826/0x6d98ed19b63827c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517506:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c216826/0x6d98ed19b63827c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517516:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c216826/0x6d98ed19b63827c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517523:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c216826/0x6d98ed19b63827c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517535:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787782985.517539:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087341127/0x6d98ed19b638283 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517551:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fce00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782985.517554:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087341127/0x6d98ed19b638283 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517562:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087341127/0x6d98ed19b638283 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517572:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087341127/0x6d98ed19b638283 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517579:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087341127/0x6d98ed19b638283 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517592:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787782985.517595:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077631e58/0x6d98ed19b63828a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517601:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fc800 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782985.517603:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077631e58/0x6d98ed19b63828a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517610:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077631e58/0x6d98ed19b63828a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517618:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077631e58/0x6d98ed19b63828a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517630:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077631e58/0x6d98ed19b63828a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517642:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787782985.517645:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000407bc855/0x6d98ed19b638291 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517651:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31421fc600 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782985.517654:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000407bc855/0x6d98ed19b638291 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517661:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000407bc855/0x6d98ed19b638291 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517671:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000407bc855/0x6d98ed19b638291 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517677:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000407bc855/0x6d98ed19b638291 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517686:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787782985.517690:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000771be891/0x6d98ed19b638298 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517695:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3102f45200 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782985.517704:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000771be891/0x6d98ed19b638298 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517711:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000771be891/0x6d98ed19b638298 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517721:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000771be891/0x6d98ed19b638298 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517728:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000771be891/0x6d98ed19b638298 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517740:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782985.517744:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058a034f9/0x6d98ed19b63829f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517750:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3102f45c00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782985.517753:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058a034f9/0x6d98ed19b63829f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517760:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058a034f9/0x6d98ed19b63829f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517769:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058a034f9/0x6d98ed19b63829f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517775:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058a034f9/0x6d98ed19b63829f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.517793:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782985.517795:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782985.517797:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787782985.518063:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.518070:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a02d0c6f/0x6d98ed19b6382a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.518081:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.518085:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.518090:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a02d0c6f/0x6d98ed19b6382a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782985.518120:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782985.518166:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a02d0c6f/0x6d98ed19b6382a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.518186:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a02d0c6f/0x6d98ed19b6382a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.518193:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a02d0c6f/0x6d98ed19b6382a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.518247:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787782985.518755:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.518761:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd529b2c/0x6d98ed19b6382ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.518770:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.518773:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.518778:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd529b2c/0x6d98ed19b6382ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.518786:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd529b2c/0x6d98ed19b6382ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.518794:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd529b2c/0x6d98ed19b6382ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.518800:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd529b2c/0x6d98ed19b6382ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.519312:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787782985.519319:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a02d0c6f/0x6d98ed19b6382a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.519327:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3102f44600 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782985.519331:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a02d0c6f/0x6d98ed19b6382a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.519340:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a02d0c6f/0x6d98ed19b6382a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.519356:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a02d0c6f/0x6d98ed19b6382a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.519363:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a02d0c6f/0x6d98ed19b6382a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.519378:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782985.519381:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd529b2c/0x6d98ed19b6382ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.519387:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3102f44e00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782985.519389:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd529b2c/0x6d98ed19b6382ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.519403:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd529b2c/0x6d98ed19b6382ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.519412:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd529b2c/0x6d98ed19b6382ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.519419:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782985.519421:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782985.519422:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782985.519486:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782985.519540:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787782985.519545:0:15013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd529b2c/0x6d98ed19b6382ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787782985.520079:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787782985.520086:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8c9240e/0x6d98ed19b6382b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.520197:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=470s v=(0 0) 00010000:00010000:1.0:1787782985.520202:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787782985.520207:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8c9240e/0x6d98ed19b6382b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.520218:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8c9240e/0x6d98ed19b6382b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.520225:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8c9240e/0x6d98ed19b6382b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.520232:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8c9240e/0x6d98ed19b6382b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782985.520281:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787782985.520468:0:15013:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1787782985.520835:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14353:x1874625922436352:12345-0@lo:5:osp-pre-0-0.0 Request processed in 63806us (63912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782985.520852:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787782985.520965:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787782985.520972:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8c9240e/0x6d98ed19b6382b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.520981:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3102f45800 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782985.520985:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8c9240e/0x6d98ed19b6382b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.520993:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8c9240e/0x6d98ed19b6382b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.521007:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8c9240e/0x6d98ed19b6382b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.521014:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8c9240e/0x6d98ed19b6382b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782985.521041:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782985.521043:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782985.521044:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782985.521227:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d1a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14353:1874625922436352:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787782985.521243:0:14353:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787782985.521286:0:14353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fde00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14353:1874625922436480:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787782985.521323:0:14353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782985.521372:0:14353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31184d9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787782985.521692:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922436480 00000100:00100000:3.0:1787782985.521697:0:15495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922436480 00000100:00100000:3.0:1787782985.521745:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782985.521755:0:15495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14353:x1874625922436480:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787782985.521792:0:15495:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1787782985.530508:0:15495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14353:x1874625922436480:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8746us (9175us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787782985.530523:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787782985.530735:0:14353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fde00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14353:1874625922436480:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787782985.530754:0:14353:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00080000:3.0:1787782985.894968:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1787782985.894981:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1787782986.150724:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782987.169423:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782988.198632:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782989.217375:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782990.241335:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787782990.561041:0:15734:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787782990.561045:0:15734:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787782990.561447:0:15734:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c3133fc1800 00000020:01000004:2.0:1787782990.561466:0:15734:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787782990.561479:0:15734:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787782990.561493:0:15734:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8c3141ef3370) 00000020:00000080:2.0:1787782990.561521:0:15734:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787782990.598444:0:15734:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787782990.600222:0:15734:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787782990.603342:0:15734:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787782990.603580:0:15734:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787782990.605492:0:15734:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787782990.607366:0:15734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 545: rc = 0 00100000:10000000:3.0:1787782990.607566:0:15734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 545: rc = 0 00100000:10000000:3.0:1787782990.607669:0:15734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 545: rc = 0 00100000:10000000:3.0:1787782990.608622:0:15734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 598: rc = 0 00100000:10000000:3.0:1787782990.609214:0:15734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 598: rc = 0 00100000:10000000:3.0:1787782990.609471:0:15734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 598: rc = 0 00100000:10000000:3.0:1787782990.610068:0:15734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 598: rc = 0 00100000:10000000:3.0:1787782990.610479:0:15734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 598: rc = 0 00100000:10000000:3.0:1787782990.611317:0:15734:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 598: rc = 0 00000020:00000080:3.0:1787782990.612209:0:15734:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787782990.612222:0:15734:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787782990.612234:0:15734:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6d98ed19b6382c2 00000020:01000004:3.0:1787782990.612243:0:15734:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787782990.612265:0:15734:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.115@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787782990.612268:0:15734:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.115@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787782990.612274:0:15734:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787782990.612296:0:15734:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787782990.612300:0:15734:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.115@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787782990.646082:0:15734:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.115@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787782990.646942:0:15734:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.115@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787782990.646947:0:15734:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787782990.646949:0:15734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787782990.646950:0:15734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782990.646951:0:15734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782990.646952:0:15734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782990.646954:0:15734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782990.646956:0:15734:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787782990.646957:0:15734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782990.646959:0:15734:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787782990.646963:0:15734:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787782990.646970:0:15734:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787782990.646972:0:15734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787782990.646973:0:15734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782990.646974:0:15734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782990.646975:0:15734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782990.646976:0:15734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782990.646977:0:15734:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787782990.646977:0:15734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782990.646978:0:15734:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787782990.647007:0:15734:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787782990.647027:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccaa1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922436608:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787782990.647251:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782990.647355:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3102e5ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1787782990.650984:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922436608 00000100:00100000:2.0:1787782990.651000:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922436608 00000100:00100000:3.0:1787782990.654120:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787782990.654137:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+16:15734:x1874625922436608:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787782990.654185:0:14324:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787782990.654189:0:14324:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787782990.654193:0:14324:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787782990.687630:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+16:15734:x1874625922436608:12345-0@lo:253:mount.lustre.0 Request processed in 33487us (40369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782990.687646:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787782990.694291:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccaa1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922436608:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787782990.694313:0:15734:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787782990.694316:0:15734:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787782990.694318:0:15734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787782990.694320:0:15734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787782990.694321:0:15734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787782990.694322:0:15734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787782990.694324:0:15734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787782990.694325:0:15734:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787782990.694327:0:15734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787782990.694328:0:15734:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787782990.694355:0:15734:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c3133fc1800 from lustre-OST0001 10000000:01000000:1.0:1787782990.694386:0:15734:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787782990.694390:0:15734:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787782990.694399:0:15734:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c31343819b8 local copy 00010000:00010000:1.0:1787782990.694410:0:15734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141205600/0x6d98ed19b638068 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63806f expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782990.694673:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922436736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782990.696009:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782990.696067:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129c58300 going to sleep for 11 seconds 00000100:00100000:3.0:1787782990.696295:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922436736 00000100:00100000:3.0:1787782990.696305:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922436736 00000100:00100000:3.0:1787782990.696363:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787782990.696373:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+16:15734:x1874625922436736:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782990.698142:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+16:15734:x1874625922436736:12345-0@lo:501:mount.lustre.0 Request processed in 1762us (2132us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787782990.698343:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787782990.701057:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922436736:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787782990.701090:0:15734:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.115@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787782990.701500:0:15734:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.115@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787782990.701511:0:15734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141205600/0x6d98ed19b638068 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63806f expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782990.701524:0:15734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141205600/0x6d98ed19b638068 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63806f expref: -99 pid: 14312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787782990.701568:0:15734:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c3133fc1800 10000000:01000000:2.0:1787782990.701573:0:15734:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787782990.701579:0:15734:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787782990.701581:0:15734:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787782990.701586:0:15734:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787782990.701590:0:15734:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787782990.701631:0:15734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141205200/0x6d98ed19b6382c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782990.701639:0:15734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141205200/0x6d98ed19b6382c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782990.701651:0:15734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141205200/0x6d98ed19b6382c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782990.701672:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346ff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922436864:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787782990.702451:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782990.702565:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31052ea6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787782990.706013:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922436864 00000100:00100000:3.0:1787782990.706028:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922436864 00000100:00100000:2.0:1787782990.709356:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787782990.709371:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+16:15734:x1874625922436864:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787782990.709390:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782990.709409:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141204400/0x6d98ed19b6382d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b6382c9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782990.709439:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141204400/0x6d98ed19b6382d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b6382c9 expref: 17 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782990.709450:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141204400/0x6d98ed19b6382d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6382c9 expref: 17 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782990.709473:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204400, rc 0) 00000100:00100000:2.0:1787782990.709684:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+17:15734:x1874625922436864:12345-0@lo:101:mount.lustre.0 Request processed in 316us (7235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782990.709703:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787782990.713388:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346ff840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922436864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782990.713418:0:15734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141205200/0x6d98ed19b6382c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6382d0 expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.713431:0:15734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141205200/0x6d98ed19b6382c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b6382d0 expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787782990.714461:0:15734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787782990.717506:0:15734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787782990.718387:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787782990.718450:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787782990.718487:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787782990.718540:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787782990.718580:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787782990.718611:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787782990.720136:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787782990.720937:0:15734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787782990.721057:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922436992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782990.721935:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782990.721990:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31052ea000 going to sleep for 11 seconds 00000100:00100000:3.0:1787782990.722131:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922436992 00000100:00100000:3.0:1787782990.722139:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922436992 00000100:00100000:3.0:1787782990.722349:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787782990.722360:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+17:15734:x1874625922436992:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787782990.724412:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+17:15734:x1874625922436992:12345-0@lo:501:mount.lustre.0 Request processed in 2047us (2472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782990.724424:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787782990.725214:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922436992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787782990.725272:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922437120:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787782990.725338:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782990.731421:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31052ea000 going to sleep for 11 seconds 00000100:00100000:1.0:1787782990.733985:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922437120 00000100:00100000:1.0:1787782990.734000:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922437120 00000100:00100000:1.0:1787782990.736820:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787782990.736858:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+17:15734:x1874625922437120:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787782990.737307:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102edac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+17:15734:x1874625922437120:12345-0@lo:503:mount.lustre.0 Request processed in 465us (11969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782990.737398:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922437120:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787782990.738002:0:15734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787782990.738122:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922437248:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782990.738174:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782990.738210:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31052ea000 going to sleep for 11 seconds 00000100:00100000:3.0:1787782990.739281:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922437248 00000100:00100000:3.0:1787782990.739291:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922437248 00000100:00100000:3.0:1787782990.739328:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787782990.739336:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+18:15734:x1874625922437248:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782990.739592:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+18:15734:x1874625922437248:12345-0@lo:502:mount.lustre.0 Request processed in 255us (1416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782990.739600:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787782990.739712:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922437248:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787782990.739997:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787782990.740052:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787782990.740086:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787782990.740170:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787782990.740206:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787782990.740239:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787782990.740286:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787782990.740324:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787782990.740369:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787782990.740402:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922437376:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782990.740449:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782990.740478:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31052ea000 going to sleep for 11 seconds 00000100:00100000:3.0:1787782990.741157:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922437376 00000100:00100000:3.0:1787782990.741163:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922437376 00000100:00100000:3.0:1787782990.741194:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787782990.741202:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+18:15734:x1874625922437376:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782990.741382:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+18:15734:x1874625922437376:12345-0@lo:502:mount.lustre.0 Request processed in 180us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782990.741399:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787782990.741521:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922437376:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787782990.741601:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787782990.741617:0:15734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787782990.742398:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787782990.742407:0:15736:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787782990.742413:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782990.742415:0:15736:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787782990.742421:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787782990.742438:0:15736:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8c31082999b8) 00000020:00000080:3.0:1787782990.742462:0:15736:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787782990.742468:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787782990.742534:0:15736:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c3133fc1800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787782990.742543:0:15736:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787782990.742551:0:15736:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x6d98ed19b6382de 00010000:00010000:3.0:1787782990.745790:0:15736:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000100:00100000:1.0:1787782990.749264:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000001:00000004:3.0:1787782990.749797:0:15736:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787782990.751775:0:15736:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787782990.762367:0:15736:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787782990.762381:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782990.762389:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782990.762391:0:15736:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787782990.762395:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782990.762399:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782990.762400:0:15736:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787782990.762403:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787782990.762405:0:15736:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787782990.762407:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782990.762409:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782990.762411:0:15736:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787782990.762413:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787782990.762415:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782990.762422:0:15736:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787782990.762426:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787782990.762494:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787782990.762498:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787782990.762500:0:15736:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787782990.762503:0:15736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787782990.765667:0:15734:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787782990.765711:0:15734:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787782990.765736:0:15734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141205200/0x6d98ed19b6382c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6382d0 expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782990.765750:0:15734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141205200/0x6d98ed19b6382c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6382d0 expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782990.765758:0:15734:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3133fc1800 from 1 10000000:01000000:1.0:1787782990.765761:0:15734:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787782990.765799:0:15734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3102f44a00/0x6d98ed19b6382e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782990.765808:0:15734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3102f44a00/0x6d98ed19b6382e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782990.765936:0:15734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3102f44a00/0x6d98ed19b6382e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782990.765963:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922437504:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787782990.766032:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782990.766133:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129c58b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787782990.768552:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922437504 00000100:00100000:3.0:1787782990.768564:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922437504 00000100:00100000:3.0:1787782990.768622:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787782990.768632:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+17:15734:x1874625922437504:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787782990.768649:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787782990.768666:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c31013a1e00/0x6d98ed19b6382ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b6382e5 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.768693:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c31013a1e00/0x6d98ed19b6382ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b6382e5 expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.768705:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c31013a1e00/0x6d98ed19b6382ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6382e5 expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.768714:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31013a1e00, rc 0) 00000100:00100000:3.0:1787782990.768802:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102eda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+18:15734:x1874625922437504:12345-0@lo:101:mount.lustre.0 Request processed in 171us (2770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782990.768960:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922437504:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782990.768979:0:15734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3102f44a00/0x6d98ed19b6382e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6382ec expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782990.768988:0:15734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3102f44a00/0x6d98ed19b6382e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b6382ec expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787782990.769573:0:15734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787782990.770088:0:15734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782990.770367:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787782990.770415:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787782990.770479:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787782990.770488:0:15734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787782990.770568:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922437632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782990.770622:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782990.770671:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922437632 00000100:00100000:1.0:1787782990.770677:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922437632 00000100:00100000:3.0:1787782990.771975:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787782990.772966:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787782990.772982:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+18:15734:x1874625922437632:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782990.773283:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102ed9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+18:15734:x1874625922437632:12345-0@lo:501:mount.lustre.0 Request processed in 307us (2660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782990.773291:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787782990.774178:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129c58b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787782990.774208:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922437632:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782990.774260:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922437760:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787782990.774317:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782990.774503:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31123f4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787782990.774559:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922437760 00000100:00100000:3.0:1787782990.774565:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922437760 00000100:00100000:3.0:1787782990.774601:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787782990.774610:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+18:15734:x1874625922437760:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787782990.774903:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102edb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+18:15734:x1874625922437760:12345-0@lo:503:mount.lustre.0 Request processed in 293us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782990.774911:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787782990.775047:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922437760:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787782990.775780:0:15734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787782990.775875:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922437888:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782990.775925:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782990.775955:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31123f4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787782990.776119:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922437888 00000100:00100000:3.0:1787782990.776125:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922437888 00000100:00100000:3.0:1787782990.776154:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787782990.776161:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+18:15734:x1874625922437888:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782990.776342:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102edb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+18:15734:x1874625922437888:12345-0@lo:502:mount.lustre.0 Request processed in 180us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782990.776349:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787782990.776475:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922437888:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787782990.776684:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787782990.776732:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787782990.776784:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787782990.776844:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787782990.776883:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787782990.776932:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787782990.776969:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787782990.777007:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787782990.777034:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922438016:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787782990.777081:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782990.777139:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31123f4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787782990.777252:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922438016 00000100:00100000:1.0:1787782990.777257:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922438016 00000100:00100000:1.0:1787782990.777284:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787782990.777291:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+18:15734:x1874625922438016:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782990.777440:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c801450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+18:15734:x1874625922438016:12345-0@lo:502:mount.lustre.0 Request processed in 149us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782990.777447:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787782990.777649:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922438016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787782990.777736:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787782990.777747:0:15734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787782990.778697:0:15740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782990.778708:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782990.778710:0:15740:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787782990.778718:0:15740:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c3133fc1800 00000020:00000080:3.0:1787782990.778720:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787782990.778727:0:15740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782990.778730:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782990.778731:0:15740:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787782990.778734:0:15740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782990.778736:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782990.778737:0:15740:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787782990.778741:0:15740:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c3133fc1800 00000020:00000080:3.0:1787782990.778749:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787782990.778809:0:15740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782990.778901:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782990.778904:0:15740:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787782990.778908:0:15740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787782990.778910:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782990.778911:0:15740:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787782990.778914:0:15740:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c3133fc1800 00000020:00000080:3.0:1787782990.778916:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787782990.778958:0:15740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787782990.778961:0:15740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787782990.778963:0:15740:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787782990.778966:0:15740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787782990.779124:0:15734:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787782990.779148:0:15734:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787782990.779166:0:15734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3102f44a00/0x6d98ed19b6382e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6382ec expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782990.779177:0:15734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3102f44a00/0x6d98ed19b6382e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6382ec expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787782990.779225:0:15734:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787782990.779227:0:15734:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c3133fc1800 10000000:01000000:1.0:1787782990.779231:0:15734:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c3133fc1800 10000000:01000000:1.0:1787782990.779235:0:15734:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787782990.779240:0:15734:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c3133fc1800 from 1 10000000:01000000:1.0:1787782990.779243:0:15734:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787782990.779273:0:15734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3102f44400/0x6d98ed19b6382f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782990.779282:0:15734:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3102f44400/0x6d98ed19b6382f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782990.779292:0:15734:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3102f44400/0x6d98ed19b6382f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782990.779314:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922438144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787782990.779368:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782990.779406:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922438144 00000100:00100000:1.0:1787782990.779411:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922438144 00000100:00100000:1.0:1787782990.779447:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787782990.779456:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c801c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+18:15734:x1874625922438144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782990.779468:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782990.779481:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3102f44200/0x6d98ed19b6382fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b6382f3 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782990.779503:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3102f44200/0x6d98ed19b6382fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b6382f3 expref: 19 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782990.779526:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3102f44200/0x6d98ed19b6382fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6382f3 expref: 19 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782990.779535:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3102f44200, rc 0) 00000100:00100000:1.0:1787782990.779564:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c801c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+19:15734:x1874625922438144:12345-0@lo:101:mount.lustre.0 Request processed in 109us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782990.779571:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787782990.779611:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129c58300 going to sleep for 11 seconds 00000100:00100000:1.0:1787782990.779631:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922438144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787782990.779644:0:15734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3102f44400/0x6d98ed19b6382f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6382fa expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782990.779653:0:15734:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3102f44400/0x6d98ed19b6382f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b6382fa expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787782990.780374:0:15734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787782990.785140:0:15734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787782990.785471:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787782990.785521:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787782990.785560:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787782990.785608:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787782990.785642:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787782990.785688:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787782990.785724:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787782990.785758:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787782990.785806:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787782990.787989:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787782990.788036:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787782990.788117:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787782990.788161:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787782990.788194:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787782990.788244:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787782990.788279:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787782990.788312:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787782990.788362:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787782990.788396:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787782990.788423:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787782990.788468:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787782990.788504:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787782990.788539:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787782990.788585:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787782990.788614:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787782990.788659:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787782990.788704:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787782990.788739:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787782990.788775:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787782990.788904:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787782990.788940:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787782990.788967:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787782990.788993:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787782990.789063:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787782990.789133:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787782990.789182:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787782990.789218:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787782990.789309:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787782990.789318:0:15734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787782990.789412:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922438272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782990.789482:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782990.789534:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129c58300 going to sleep for 11 seconds 00000100:00100000:0.0:1787782990.789692:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922438272 00000100:00100000:0.0:1787782990.789700:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922438272 00000100:00100000:0.0:1787782990.793023:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787782990.793041:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+19:15734:x1874625922438272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787782990.793435:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c802450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+19:15734:x1874625922438272:12345-0@lo:501:mount.lustre.0 Request processed in 399us (3952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782990.793444:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787782990.798223:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922438272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787782990.798298:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922438400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787782990.798371:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782990.801979:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129c58300 going to sleep for 11 seconds 00000100:00100000:0.0:1787782990.803209:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922438400 00000100:00100000:0.0:1787782990.803222:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922438400 00000100:00100000:0.0:1787782990.804940:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787782990.804958:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+19:15734:x1874625922438400:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787782990.805381:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c803850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+19:15734:x1874625922438400:12345-0@lo:503:mount.lustre.0 Request processed in 428us (7009us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782990.805389:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787782990.808012:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922438400:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787782990.808628:0:15734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787782990.808728:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922438528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782990.808799:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782990.808859:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129c58300 going to sleep for 11 seconds 00000100:00100000:2.0:1787782990.808934:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922438528 00000100:00100000:2.0:1787782990.808940:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922438528 00000100:00100000:2.0:1787782990.808986:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787782990.808996:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c803450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+19:15734:x1874625922438528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787782990.809295:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c803450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+19:15734:x1874625922438528:12345-0@lo:502:mount.lustre.0 Request processed in 300us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782990.809305:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787782990.809417:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922438528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787782990.809670:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787782990.809719:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787782990.809749:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787782990.809795:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787782990.809842:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787782990.809892:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787782990.809929:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787782990.809962:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787782990.810009:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787782990.810046:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787782990.810077:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787782990.811327:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787782990.811376:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787782990.811413:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787782990.811460:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787782990.811492:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787782990.811545:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787782990.811597:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787782990.811632:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787782990.811679:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787782990.811741:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787782990.811781:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787782990.811816:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787782990.811878:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787782990.811915:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787782990.811950:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787782990.811998:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787782990.812032:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787782990.812064:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787782990.812669:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787782990.812716:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787782990.812745:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787782990.812795:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787782990.812912:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787782990.812951:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787782990.812996:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787782990.813029:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787782990.813058:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787782990.813138:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787782990.813179:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787782990.813228:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922438656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787782990.813305:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782990.813350:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129c58300 going to sleep for 11 seconds 00000100:00100000:3.0:1787782990.813417:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922438656 00000100:00100000:3.0:1787782990.813425:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922438656 00000100:00100000:3.0:1787782990.813476:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787782990.813486:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+19:15734:x1874625922438656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787782990.813701:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c800450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+19:15734:x1874625922438656:12345-0@lo:502:mount.lustre.0 Request processed in 216us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782990.813709:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787782990.813767:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922438656:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787782990.813846:0:15734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787782990.813856:0:15734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787782990.815707:0:15745:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787782990.815727:0:15745:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8c31184199b8) 00000020:00000080:0.0:1787782990.815752:0:15745:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1787782990.815837:0:15745:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c3133fc1800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787782990.815842:0:15745:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c3133fc1800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787782990.815845:0:15745:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c3133fc1800 3 00010000:00080000:0.0:1787782990.815891:0:15745:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c3001ddc000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.115@tcp at head 00010000:00010000:0.0:1787782990.817538:0:15745:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1787782990.817817:0:15745:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787782990.817859:0:15745:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787782990.817871:0:15745:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x6d98ed19b638308 00000100:00080000:0.0:1787782990.817880:0:15745:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787782990.817885:0:15745:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c3001ddc000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:0.0:1787782990.817919:0:15745:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c313c97f480 x1874625922438784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787782990.817947:0:15745:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787782990.818356:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625922438784:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787782990.818429:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782990.818491:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922438784 00000100:00100000:2.0:1787782990.818498:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922438784 00000100:00100000:2.0:1787782990.818528:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787782990.818535:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1874625922438784:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787782990.818558:0:14331:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 475 last 0 00000020:00000080:2.0:1787782990.818590:0:14331:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x6d98ed19b63830f 00000004:00100000:2.0:1787782990.818606:0:14331:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787782990.818637:0:14331:0:(import.c:65:import_set_state_nolock()) ffff8c313438e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782990.818690:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874625922438784:12345-0@lo:38:llog_process_th.0 Request processed in 153us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782990.818697:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787782990.818732:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c313c97f480 x1874625922438784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787783000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782990.818754:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787782990.818762:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787782990.818770:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787782990.818774:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787782990.818776:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c3001ddc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787782990.818782:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874625922438784:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787782990.820318:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1787782990.820339:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782990.820344:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787782990.820348:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c3001e17000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787782990.820355:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:1.0:1787782990.820359:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787782990.820364:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c3001e17000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787782990.820389:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c31411d2940 x1874625922439040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:3.0:1787782990.821716:0:15745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787782990.821917:0:15734:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787782990.821947:0:15734:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787782990.821969:0:15734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3102f44400/0x6d98ed19b6382f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6382fa expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782990.821979:0:15734:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3102f44400/0x6d98ed19b6382f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6382fa expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787782990.822024:0:15734:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787782990.822026:0:15734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787782990.822027:0:15734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782990.822029:0:15734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782990.822031:0:15734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782990.822032:0:15734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782990.822034:0:15734:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782990.822035:0:15734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782990.822037:0:15734:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787782990.822040:0:15734:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787782990.822043:0:15734:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787782990.822044:0:15734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787782990.822045:0:15734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787782990.822046:0:15734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787782990.822047:0:15734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787782990.822048:0:15734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787782990.822049:0:15734:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787782990.822055:0:15734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787782990.822056:0:15734:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787782990.822078:0:15734:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787782990.822124:0:15734:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922439296:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787782990.822190:0:15734:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782990.822233:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922439296 00000100:00100000:2.0:1787782990.822240:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922439296 00000100:00100000:2.0:1787782990.822276:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787782990.822285:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c801050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+19:15734:x1874625922439296:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787782990.822309:0:14324:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787782990.822323:0:14324:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787782990.823721:0:15734:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3107068600 going to sleep for 11 seconds 00000100:00100000:0.0:1787782990.823983:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625922439168:0@lo:400:kworker.0 00000100:00100000:0.0:1787782990.824034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782990.824069:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922438912:0@lo:400:kworker.0 00000100:00100000:0.0:1787782990.824090:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782990.824181:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922439168 00000100:00100000:3.0:1787782990.824189:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922439168 00000100:00100000:3.0:1787782990.824237:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787782990.824246:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625922439168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782990.824300:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874625922439168:12345-0@lo:400:kworker.0 Request processed in 56us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782990.824319:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787782990.824341:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922438912 00000100:00100000:3.0:1787782990.824344:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922438912 00000100:00100000:3.0:1787782990.824387:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787782990.824394:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922438912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787782990.824427:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922438912:12345-0@lo:400:kworker.0 Request processed in 34us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782990.824433:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787782990.824450:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787782990.824477:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c31411d0000 x1874625922439168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787783006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782990.824491:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874625922439168:0@lo:400:kworker.0 00000100:00100000:3.0:1787782990.824507:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787782990.824523:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922438912:0@lo:400:kworker.0 00000100:00100000:1.0:1787782990.824678:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922439040:0@lo:8:kworker.0 00000100:00100000:1.0:1787782990.824712:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782990.824997:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922439040 00000100:00100000:0.0:1787782990.825002:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922439040 00000100:00100000:0.0:1787782990.825022:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787782990.825027:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3303:x1874625922439040:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787782990.825070:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3303:x1874625922439040:12345-0@lo:8:kworker.0 Request processed in 42us (357us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787782990.825076:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787782990.825922:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787782990.825931:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c3001e17000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787782990.825936:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787782990.825940:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922439040:0@lo:8:kworker.0 00000100:00100000:1.0:1787782990.826008:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922439424:0@lo:400:kworker.0 00000100:00100000:1.0:1787782990.826044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782990.826078:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922439424 00000100:00100000:1.0:1787782990.826083:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922439424 00000100:00100000:1.0:1787782990.826139:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787782990.826147:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922439424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782990.826186:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922439424:12345-0@lo:400:kworker.0 Request processed in 41us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782990.826193:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1787782990.826208:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787782990.826229:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c31411d2940 x1874625922439424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787783006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782990.826241:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922439424:0@lo:400:kworker.0 20000000:01000000:3.0:1787782990.852066:0:14324:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787782990.852091:0:14324:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787782990.852411:0:14346:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787782990.852417:0:14346:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787782990.852441:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c3102f45600/0x6d98ed19b638316 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782990.852482:0:14346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3141204a00/0x6d98ed19b6381f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6381e9 expref: 19 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782990.852491:0:14346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c3102f45600/0x6d98ed19b638316 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782990.852532:0:14346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3141204a00/0x6d98ed19b6381f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b6381e9 expref: 19 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782990.852547:0:14346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c3141204a00/0x6d98ed19b6381f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b6381e9 expref: 19 pid: 14324 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787782990.852562:0:14346:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14346:1874625922439552:0@lo:104: 00000100:00100000:1.0:1787782990.852630:0:14346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782990.852693:0:14346:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129c58840 going to sleep for 11 seconds 00000100:00100000:3.0:1787782990.852768:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922439552 00000100:00100000:3.0:1787782990.852776:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922439552 00000100:00100000:3.0:1787782990.852839:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782990.852850:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48c63e6d-1dfe-4772-affc-638938210ba4+3:14346:x1874625922439552:12345-0@lo:104: 00010000:00010000:3.0:1787782990.852865:0:14314:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31013a0a00/0x6d98ed19b6381e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b6381f0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.852924:0:14314:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787782990.852931:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:48c63e6d-1dfe-4772-affc-638938210ba4+3:14346:x1874625922439552:12345-0@lo:104: Request processed in 84us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782990.852950:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787782990.852973:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782990.852979:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31013a0a00/0x6d98ed19b6381e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b6381f0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.852987:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0a00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:3.0:1787782990.852991:0:14318:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a0a00/0x6d98ed19b6381e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b6381f0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.852999:0:14318:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31013a0a00/0x6d98ed19b6381e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b6381f0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787782990.853007:0:14318:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a0a00/0x6d98ed19b6381e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b6381f0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787782990.853013:0:14318:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787782990.853043:0:14318:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31013a0a00/0x6d98ed19b6381e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6381f0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.853050:0:14318:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787782990.853070:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31013a0a00/0x6d98ed19b6381e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6381f0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.853078:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31013a0a00/0x6d98ed19b6381e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6381f0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.853119:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782990.853121:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782990.853122:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787782990.853142:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cca9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c63e6d-1dfe-4772-affc-638938210ba4:3307:1874625922439680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787782990.853179:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782990.853220:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922439680 00000100:00100000:3.0:1787782990.853224:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922439680 00010000:00010000:3.0:1787782990.853243:0:14317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3141204a00/0x6d98ed19b6381f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b6381e9 expref: 20 pid: 14324 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782990.853266:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782990.853272:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cca9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c63e6d-1dfe-4772-affc-638938210ba4+20:3307:x1874625922439680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782990.853282:0:14317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787782990.853287:0:14317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3141204a00/0x6d98ed19b6381f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b6381e9 expref: 20 pid: 14324 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.853297:0:14317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3141204a00/0x6d98ed19b6381f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b6381e9 expref: 20 pid: 14324 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.853315:0:14317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c3102f45600/0x6d98ed19b638316 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.853323:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3102f45600/0x6d98ed19b638316 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787782990.853337:0:14317:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002641823s 00010000:00010000:3.0:1787782990.853341:0:14317:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3102f45600/0x6d98ed19b638316 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.853348:0:14317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3102f45600/0x6d98ed19b638316 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.853355:0:14317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c3102f45600/0x6d98ed19b638316 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.853371:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c3102f45600/0x6d98ed19b638316 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.853377:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3102f45600 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787782990.853382:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c3102f45600/0x6d98ed19b638316 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.853390:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c3102f45600/0x6d98ed19b638316 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.853398:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c3102f45600/0x6d98ed19b638316 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.853408:0:14317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787782990.853438:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cca9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c63e6d-1dfe-4772-affc-638938210ba4+20:3307:x1874625922439680:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782990.853445:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787782990.853481:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cca9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c63e6d-1dfe-4772-affc-638938210ba4:3307:1874625922439680:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787782990.853513:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3141204a00/0x6d98ed19b6381f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b6381e9 expref: 19 pid: 14324 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787782990.853524:0:14346:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2940 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14346:1874625922439552:0@lo:104: 00010000:00010000:3.0:1787782990.853537:0:14346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c3102f45600/0x6d98ed19b638316 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.853546:0:14346:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c3102f45600/0x6d98ed19b638316 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.853551:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c3102f45600/0x6d98ed19b638316 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782990.853564:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3102f45600/0x6d98ed19b638316 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787782990.862486:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c801050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+18:15734:x1874625922439296:12345-0@lo:253:mount.lustre.0 Request processed in 40189us (40283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782990.862504:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787782990.862596:0:15734:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fda40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:48c63e6d-1dfe-4772-affc-638938210ba4:15734:1874625922439296:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787782990.862612:0:15734:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787782990.862616:0:15734:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787782990.862618:0:15734:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787782990.862619:0:15734:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787782990.862620:0:15734:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787782990.862621:0:15734:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787782990.862622:0:15734:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787782990.862624:0:15734:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787782990.862625:0:15734:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787782990.862627:0:15734:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787782990.862641:0:15734:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787782990.867232:0:15734:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782990.867405:0:15734:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787782990.867573:0:15734:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782990.867812:0:15734:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787782990.867989:0:15734:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787782990.868245:0:15734:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787782990.869646:0:15734:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787782990.924609:0:15734:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787782990.924619:0:15734:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787782990.924656:0:15734:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787782990.924717:0:15734:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.115@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787782990.924734:0:15734:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787782990.924774:0:15734:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:3.0:1787782990.951345:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922439808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787782990.951419:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782990.951500:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922439808 00000100:00100000:3.0:1787782990.951514:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922439808 00000100:00100000:3.0:1787782990.951562:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787782990.951570:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cca9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922439808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787782990.951604:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787782990.951644:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cca9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922439808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782990.951651:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787782990.951698:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922439808:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787782991.265848:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787782992.225912:0:14327:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787782992.225920:0:14327:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c3129e3b800 from 8 10000000:01000000:0.0:1787782992.225924:0:14327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787782992.225970:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141254000/0x6d98ed19b63831d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782992.225983:0:14327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141254000/0x6d98ed19b63831d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782992.226006:0:14327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141254000/0x6d98ed19b63831d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782992.226033:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922439936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787782992.226125:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782992.226172:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3108f07480 going to sleep for 11 seconds 00000100:00100000:1.0:1787782992.226589:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922439936 00000100:00100000:1.0:1787782992.226598:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922439936 00000100:00100000:1.0:1787782992.226656:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787782992.226664:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+18:14327:x1874625922439936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787782992.226677:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782992.226692:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3102f45000/0x6d98ed19b638324 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b63831d expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782992.226716:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3102f45000/0x6d98ed19b638324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b63831d expref: 19 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782992.226726:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3102f45000/0x6d98ed19b638324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b63831d expref: 19 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782992.226759:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3102f45000, rc 0) 00000100:00100000:1.0:1787782992.226805:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+19:14327:x1874625922439936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782992.226823:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787782992.226900:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922439936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787782992.226915:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141254000/0x6d98ed19b63831d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638324 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782992.226924:0:14327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141254000/0x6d98ed19b63831d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b638324 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787782992.227135:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922440064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787782992.227178:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787782992.227213:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3108f07480 going to sleep for 11 seconds 00000100:00100000:1.0:1787782992.227466:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922440064 00000100:00100000:1.0:1787782992.227471:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922440064 00000100:00100000:1.0:1787782992.227516:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787782992.227524:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+19:14327:x1874625922440064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787782992.227540:0:14324:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787782992.227556:0:14324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787782992.227559:0:14324:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787782992.227646:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+19:14327:x1874625922440064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782992.227652:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787782992.227703:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922440064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787782992.227761:0:14327:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787782992.227768:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141254000/0x6d98ed19b63831d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638324 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782992.227777:0:14327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141254000/0x6d98ed19b63831d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638324 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782992.292217:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787782992.611434:0:14364:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787782993.313322:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782994.348220:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787782995.361440:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787782996.074263:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922440192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787782996.077759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782996.077917:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922440192 00000100:00100000:2.0:1787782996.077927:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922440192 00000100:00100000:2.0:1787782996.077994:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787782996.078004:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922440192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787782996.078043:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787782996.078126:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922440192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (3772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782996.078134:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787782996.078183:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922440192:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787782996.079425:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787782996.079516:0:13877:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787782996.079521:0:13877:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787782996.079524:0:13877:0:(import.c:65:import_set_state_nolock()) ffff8c3001e17000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787782996.079534:0:13877:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c3001e17000 using connection 192.168.202.115@tcp/0@lo 00000100:00100000:1.0:1787782996.079555:0:13877:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c31411d03c0 x1874625922440448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787782996.079638:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c63e6d-1dfe-4772-affc-638938210ba4:3306:1874625922440320:0@lo:400:kworker.0 00000100:00100000:1.0:1787782996.079693:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782996.079732:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787782996.079750:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922440576:0@lo:400:kworker.0 00000100:00100000:1.0:1787782996.079792:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782996.079822:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922440448:0@lo:8:kworker.0 00000100:00100000:1.0:1787782996.079848:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787782996.080074:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922440320 00000100:00100000:1.0:1787782996.080081:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922440320 00000100:00100000:1.0:1787782996.080140:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787782996.080148:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+19:3306:x1874625922440320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782996.080190:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+19:3306:x1874625922440320:12345-0@lo:400:kworker.0 Request processed in 43us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782996.080196:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787782996.080226:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922440576 00000100:00100000:1.0:1787782996.080229:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922440576 00000100:00100000:1.0:1787782996.080428:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787782996.080569:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922440704:0@lo:400:kworker.0 00000100:00100000:2.0:1787782996.080608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782996.080632:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787782996.080638:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922440832:0@lo:400:kworker.0 00000100:00100000:2.0:1787782996.080661:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782996.080680:0:14332:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787782996.080688:0:14332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787782996.081065:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922440576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782996.081128:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922440576:12345-0@lo:400:kworker.0 Request processed in 693us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782996.081135:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787782996.081147:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922440704 00000100:00100000:1.0:1787782996.081151:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922440704 00000100:00100000:1.0:1787782996.081175:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922440832 00000100:00100000:1.0:1787782996.081179:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922440832 00000100:00100000:1.0:1787782996.081192:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787782996.081197:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922440704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782996.081231:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874625922440704:12345-0@lo:400:kworker.0 Request processed in 33us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782996.081237:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787782996.081260:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787782996.081266:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922440832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787782996.081295:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922440832:12345-0@lo:400:kworker.0 Request processed in 29us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782996.081301:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787782996.081319:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922440448 00000100:00100000:1.0:1787782996.081323:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922440448 00000100:00100000:1.0:1787782996.081341:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787782996.081346:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1874625922440448:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787782996.081370:0:15012:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:1.0:1787782996.081398:0:15012:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6d98ed19b63832b 00002000:00100000:1.0:1787782996.081411:0:15012:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c31061eb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113937 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787782996.081416:0:15012:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787782996.081418:0:15012:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787782996.081893:0:15012:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787782996.081917:0:15012:0:(import.c:65:import_set_state_nolock()) ffff8c31061ef800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787782996.081963:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874625922440448:12345-0@lo:8:kworker.0 Request processed in 615us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782996.081971:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787782996.082188:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31411d2940 x1874625922440576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787783012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787782996.082203:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922440576:0@lo:400:kworker.0 00000100:00100000:1.0:1787782996.082214:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c63e6d-1dfe-4772-affc-638938210ba4:3306:1874625922440320:0@lo:400:kworker.0 00000100:00080000:1.0:1787782996.082242:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787782996.082266:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31411d03c0 x1874625922440448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787783021 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787782996.082286:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787782996.082293:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787782996.082299:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787782996.082302:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8c3001e17000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00010000:00080000:2.0:1787782996.088301:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31411d0000 x1874625922440832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787783012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782996.088320:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922440832:0@lo:400:kworker.0 00010000:00080000:2.0:1787782996.088336:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c31411d3c00 x1874625922440704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787783012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787782996.088346:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874625922440704:0@lo:400:kworker.0 00000004:00080000:3.0:1787782996.090678:0:14355:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1787782996.092303:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccaa940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14355:1874625922441088:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787782996.092391:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782996.092429:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31107e2480 going to sleep for 11 seconds 00000100:00100000:3.0:1787782996.093623:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313ccab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922440960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787782996.093678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787782996.093929:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922441088 00000100:00100000:3.0:1787782996.093937:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922441088 00000100:00100000:3.0:1787782996.094913:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787782996.094926:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cca9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14355:x1874625922441088:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787782996.097198:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787782996.097214:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874625922440448:0@lo:8:kworker.0 00000004:00080000:1.0:1787782996.097281:0:14354:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787782996.097694:0:14354:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 480767596899ns, next at 0ns, rc = 0 00000100:00080000:2.0:1787782996.098639:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787782996.098666:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922440960 00000100:00100000:2.0:1787782996.098675:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922440960 00000100:00100000:2.0:1787782996.098725:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787782996.098734:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccaad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874625922440960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787782996.098764:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787782996.098858:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccaad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874625922440960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (5179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782996.098865:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787782996.112014:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c313ccab480 x1874625922440960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787783012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787782996.112049:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922440960:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1787782996.113393:0:15014:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787782996.113409:0:15014:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787782996.113414:0:15014:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1787782996.122144:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.122157:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005416bc48/0x6d98ed19b638332 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.122175:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.122179:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.122186:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005416bc48/0x6d98ed19b638332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.122205:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005416bc48/0x6d98ed19b638332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.122217:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005416bc48/0x6d98ed19b638332 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.122225:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005416bc48/0x6d98ed19b638332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.122241:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787782996.122923:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.122931:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2d40dc/0x6d98ed19b638339 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.122941:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.122945:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.122950:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f2d40dc/0x6d98ed19b638339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.122969:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f2d40dc/0x6d98ed19b638339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.122978:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f2d40dc/0x6d98ed19b638339 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.122985:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f2d40dc/0x6d98ed19b638339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.123007:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787782996.123433:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.123439:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b025144/0x6d98ed19b638340 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.123447:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.123451:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.123456:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b025144/0x6d98ed19b638340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.123465:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b025144/0x6d98ed19b638340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.123473:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b025144/0x6d98ed19b638340 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.123602:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b025144/0x6d98ed19b638340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.123611:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787782996.124017:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.124023:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c16a91/0x6d98ed19b638347 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.124031:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.124034:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.124039:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c16a91/0x6d98ed19b638347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.124047:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1c16a91/0x6d98ed19b638347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.124054:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c16a91/0x6d98ed19b638347 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.124060:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c16a91/0x6d98ed19b638347 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.124067:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787782996.124479:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.124485:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baebb765/0x6d98ed19b63834e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.124499:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.124503:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.124508:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000baebb765/0x6d98ed19b63834e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.124519:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000baebb765/0x6d98ed19b63834e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.124528:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000baebb765/0x6d98ed19b63834e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.124536:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000baebb765/0x6d98ed19b63834e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.124545:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787782996.124939:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.124945:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000088b0817/0x6d98ed19b638355 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.124954:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.124958:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.124963:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000088b0817/0x6d98ed19b638355 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.124973:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000088b0817/0x6d98ed19b638355 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.124994:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000088b0817/0x6d98ed19b638355 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.125001:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000088b0817/0x6d98ed19b638355 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.125011:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1787782996.125423:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.125430:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002bbe389/0x6d98ed19b63835c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.125439:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.125443:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.125447:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002bbe389/0x6d98ed19b63835c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.125457:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002bbe389/0x6d98ed19b63835c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.125467:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002bbe389/0x6d98ed19b63835c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.125475:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002bbe389/0x6d98ed19b63835c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.125495:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1787782996.125879:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.125885:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b638363 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.125894:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.125897:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.125901:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b638363 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.125912:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b638363 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.125921:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b638363 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.125929:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b638363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.125938:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:3.0:1787782996.126350:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.126357:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000176ef5d/0x6d98ed19b63836a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.126365:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.126374:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.126380:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000176ef5d/0x6d98ed19b63836a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.126390:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000176ef5d/0x6d98ed19b63836a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.126397:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000176ef5d/0x6d98ed19b63836a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.126404:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000176ef5d/0x6d98ed19b63836a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.126412:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:3.0:1787782996.127197:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.127205:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c210c1e6/0x6d98ed19b638371 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.127216:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.127220:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.127225:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c210c1e6/0x6d98ed19b638371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.127236:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c210c1e6/0x6d98ed19b638371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.127245:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c210c1e6/0x6d98ed19b638371 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.127259:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c210c1e6/0x6d98ed19b638371 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.127267:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:3.0:1787782996.127686:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.127823:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffbd56db/0x6d98ed19b638378 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.127835:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.127838:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.127843:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffbd56db/0x6d98ed19b638378 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.127852:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffbd56db/0x6d98ed19b638378 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.127861:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffbd56db/0x6d98ed19b638378 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.127868:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffbd56db/0x6d98ed19b638378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.127877:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:3.0:1787782996.128304:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.128311:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083bb30a8/0x6d98ed19b63837f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.128326:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.128329:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.128333:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083bb30a8/0x6d98ed19b63837f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.128343:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083bb30a8/0x6d98ed19b63837f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.128351:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083bb30a8/0x6d98ed19b63837f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.128359:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083bb30a8/0x6d98ed19b63837f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.128367:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00010000:00010000:1.0:1787782996.129902:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1787782996.129916:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005416bc48/0x6d98ed19b638332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.129931:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0a00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.129937:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005416bc48/0x6d98ed19b638332 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.129961:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005416bc48/0x6d98ed19b638332 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.129989:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005416bc48/0x6d98ed19b638332 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.129997:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005416bc48/0x6d98ed19b638332 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787782996.130010:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.130018:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e27ca2d/0x6d98ed19b638386 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130021:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1787782996.130030:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=480s v=(0 0) 00010000:00010000:1.0:1787782996.130033:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f2d40dc/0x6d98ed19b638339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.130036:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.130047:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e27ca2d/0x6d98ed19b638386 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130047:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0200 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.130053:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f2d40dc/0x6d98ed19b638339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.130068:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e27ca2d/0x6d98ed19b638386 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130069:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f2d40dc/0x6d98ed19b638339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130090:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f2d40dc/0x6d98ed19b638339 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.130120:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e27ca2d/0x6d98ed19b638386 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.130130:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e27ca2d/0x6d98ed19b638386 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130141:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f2d40dc/0x6d98ed19b638339 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.130146:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:1.0:1787782996.130160:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1787782996.130166:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b025144/0x6d98ed19b638340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130172:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1800 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.130176:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b025144/0x6d98ed19b638340 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130184:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b025144/0x6d98ed19b638340 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130208:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b025144/0x6d98ed19b638340 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130214:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b025144/0x6d98ed19b638340 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130230:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1787782996.130234:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1c16a91/0x6d98ed19b638347 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130241:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1200 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.130244:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c16a91/0x6d98ed19b638347 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130252:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c16a91/0x6d98ed19b638347 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130263:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1c16a91/0x6d98ed19b638347 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130270:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1c16a91/0x6d98ed19b638347 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130284:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1787782996.130288:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000baebb765/0x6d98ed19b63834e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130302:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0e00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.130305:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000baebb765/0x6d98ed19b63834e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130314:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000baebb765/0x6d98ed19b63834e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130325:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000baebb765/0x6d98ed19b63834e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130333:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000baebb765/0x6d98ed19b63834e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130350:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1787782996.130353:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000088b0817/0x6d98ed19b638355 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130360:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1c00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.130364:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000088b0817/0x6d98ed19b638355 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130371:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000088b0817/0x6d98ed19b638355 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130381:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000088b0817/0x6d98ed19b638355 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130394:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000088b0817/0x6d98ed19b638355 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130408:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787782996.130412:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002bbe389/0x6d98ed19b63835c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130420:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1a00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.130423:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002bbe389/0x6d98ed19b63835c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.130431:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002bbe389/0x6d98ed19b63835c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787782996.130692:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.130699:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062ff529/0x6d98ed19b63838d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.131590:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.131600:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.131608:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000062ff529/0x6d98ed19b63838d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.131623:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000062ff529/0x6d98ed19b63838d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.131631:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000062ff529/0x6d98ed19b63838d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.131638:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000062ff529/0x6d98ed19b63838d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.131667:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1787782996.132350:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.132357:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc5ecbb1/0x6d98ed19b638394 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.132367:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.132371:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.132375:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5ecbb1/0x6d98ed19b638394 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.132385:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc5ecbb1/0x6d98ed19b638394 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.132393:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc5ecbb1/0x6d98ed19b638394 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.132400:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc5ecbb1/0x6d98ed19b638394 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.132409:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:2.0:1787782996.133219:0:14319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1787782996.133457:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002bbe389/0x6d98ed19b63835c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133468:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002bbe389/0x6d98ed19b63835c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133493:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787782996.133498:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000176ef5d/0x6d98ed19b63836a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133505:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f5000 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.133519:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000176ef5d/0x6d98ed19b63836a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133530:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000176ef5d/0x6d98ed19b63836a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133540:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000176ef5d/0x6d98ed19b63836a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133546:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000176ef5d/0x6d98ed19b63836a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133558:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787782996.133562:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c210c1e6/0x6d98ed19b638371 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133567:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f5e00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.133571:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c210c1e6/0x6d98ed19b638371 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133579:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c210c1e6/0x6d98ed19b638371 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133588:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c210c1e6/0x6d98ed19b638371 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133595:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c210c1e6/0x6d98ed19b638371 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133615:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787782996.133618:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffbd56db/0x6d98ed19b638378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133626:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f5800 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.133629:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffbd56db/0x6d98ed19b638378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133637:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffbd56db/0x6d98ed19b638378 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133646:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffbd56db/0x6d98ed19b638378 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133652:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffbd56db/0x6d98ed19b638378 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133663:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787782996.133667:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083bb30a8/0x6d98ed19b63837f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133672:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f4800 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.133675:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083bb30a8/0x6d98ed19b63837f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133691:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083bb30a8/0x6d98ed19b63837f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133701:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083bb30a8/0x6d98ed19b63837f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133708:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083bb30a8/0x6d98ed19b63837f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133722:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787782996.133726:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e27ca2d/0x6d98ed19b638386 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133732:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f4c00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.133735:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e27ca2d/0x6d98ed19b638386 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133742:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e27ca2d/0x6d98ed19b638386 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133752:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e27ca2d/0x6d98ed19b638386 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133757:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e27ca2d/0x6d98ed19b638386 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133794:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787782996.133798:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000062ff529/0x6d98ed19b63838d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133805:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f5400 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.133810:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000062ff529/0x6d98ed19b63838d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133817:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000062ff529/0x6d98ed19b63838d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133827:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000062ff529/0x6d98ed19b63838d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133833:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000062ff529/0x6d98ed19b63838d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133846:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782996.133850:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc5ecbb1/0x6d98ed19b638394 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133856:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f5600 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.133860:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc5ecbb1/0x6d98ed19b638394 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133880:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc5ecbb1/0x6d98ed19b638394 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133890:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc5ecbb1/0x6d98ed19b638394 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133896:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc5ecbb1/0x6d98ed19b638394 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.133909:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782996.133910:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782996.133912:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782996.136336:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.136351:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002ccda39/0x6d98ed19b63839b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.136370:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.136384:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.136392:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002ccda39/0x6d98ed19b63839b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.136406:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002ccda39/0x6d98ed19b63839b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.136416:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002ccda39/0x6d98ed19b63839b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.136423:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002ccda39/0x6d98ed19b63839b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.136447:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787782996.137244:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.137253:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093eb5c2e/0x6d98ed19b6383a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.137264:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.137268:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.137273:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093eb5c2e/0x6d98ed19b6383a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.137283:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093eb5c2e/0x6d98ed19b6383a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.137290:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093eb5c2e/0x6d98ed19b6383a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.137304:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093eb5c2e/0x6d98ed19b6383a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.137313:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787782996.138686:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.139143:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9c445c7/0x6d98ed19b6383a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.139160:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.139164:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.139171:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9c445c7/0x6d98ed19b6383a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.139184:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9c445c7/0x6d98ed19b6383a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.139195:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9c445c7/0x6d98ed19b6383a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.139204:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9c445c7/0x6d98ed19b6383a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.139216:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787782996.139983:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.139992:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac542c4e/0x6d98ed19b6383b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.140009:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.140012:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.140018:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac542c4e/0x6d98ed19b6383b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.140028:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac542c4e/0x6d98ed19b6383b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.140036:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac542c4e/0x6d98ed19b6383b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.140043:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac542c4e/0x6d98ed19b6383b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.140051:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787782996.141083:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.141124:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e705c7aa/0x6d98ed19b6383b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.141137:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.141141:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.141146:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e705c7aa/0x6d98ed19b6383b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.141158:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e705c7aa/0x6d98ed19b6383b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.141179:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e705c7aa/0x6d98ed19b6383b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.141186:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e705c7aa/0x6d98ed19b6383b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.141196:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1787782996.142927:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787782996.142941:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002ccda39/0x6d98ed19b63839b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.142955:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a057c00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.142960:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002ccda39/0x6d98ed19b63839b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.142970:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002ccda39/0x6d98ed19b63839b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.142992:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002ccda39/0x6d98ed19b63839b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143014:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002ccda39/0x6d98ed19b63839b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143037:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787782996.143042:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093eb5c2e/0x6d98ed19b6383a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143049:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a057200 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.143052:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093eb5c2e/0x6d98ed19b6383a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143059:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093eb5c2e/0x6d98ed19b6383a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143070:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093eb5c2e/0x6d98ed19b6383a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143078:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093eb5c2e/0x6d98ed19b6383a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143091:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787782996.143112:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9c445c7/0x6d98ed19b6383a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143119:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a056a00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.143129:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9c445c7/0x6d98ed19b6383a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143138:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9c445c7/0x6d98ed19b6383a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143150:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9c445c7/0x6d98ed19b6383a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143157:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9c445c7/0x6d98ed19b6383a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143171:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787782996.143174:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac542c4e/0x6d98ed19b6383b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143182:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a056400 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.143186:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac542c4e/0x6d98ed19b6383b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143193:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac542c4e/0x6d98ed19b6383b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143203:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac542c4e/0x6d98ed19b6383b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143210:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac542c4e/0x6d98ed19b6383b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143232:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782996.143236:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e705c7aa/0x6d98ed19b6383b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143244:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a056200 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.143247:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e705c7aa/0x6d98ed19b6383b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143254:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e705c7aa/0x6d98ed19b6383b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143265:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e705c7aa/0x6d98ed19b6383b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143272:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e705c7aa/0x6d98ed19b6383b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143285:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782996.143287:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782996.143289:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782996.143311:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.143319:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d825921/0x6d98ed19b6383be lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.143331:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.143336:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.143342:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d825921/0x6d98ed19b6383be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.143356:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d825921/0x6d98ed19b6383be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.143365:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d825921/0x6d98ed19b6383be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.143374:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d825921/0x6d98ed19b6383be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.143403:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782996.143421:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782996.143427:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d825921/0x6d98ed19b6383be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143434:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a057600 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.143438:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d825921/0x6d98ed19b6383be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143452:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d825921/0x6d98ed19b6383be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143463:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d825921/0x6d98ed19b6383be lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143471:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d825921/0x6d98ed19b6383be lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.143484:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782996.143486:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782996.143488:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782996.146549:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.146562:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d359f7/0x6d98ed19b6383c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.146579:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.146584:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.146591:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d359f7/0x6d98ed19b6383c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.146604:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1d359f7/0x6d98ed19b6383c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.146613:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1d359f7/0x6d98ed19b6383c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.146620:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1d359f7/0x6d98ed19b6383c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.146641:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787782996.147155:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.147161:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003547e954/0x6d98ed19b6383cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.147169:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.147178:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.147183:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003547e954/0x6d98ed19b6383cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.147193:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003547e954/0x6d98ed19b6383cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.147202:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003547e954/0x6d98ed19b6383cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.147209:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003547e954/0x6d98ed19b6383cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.147218:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787782996.147625:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.147631:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010729115/0x6d98ed19b6383d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.147640:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.147643:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.147647:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010729115/0x6d98ed19b6383d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.147657:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010729115/0x6d98ed19b6383d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.147665:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010729115/0x6d98ed19b6383d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.147680:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010729115/0x6d98ed19b6383d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.147688:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787782996.148433:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00002000:00010000:3.0:1787782996.148610:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.148618:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054108510/0x6d98ed19b6383da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.148630:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.148634:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.148640:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054108510/0x6d98ed19b6383da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.148652:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054108510/0x6d98ed19b6383da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.148659:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054108510/0x6d98ed19b6383da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.148666:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054108510/0x6d98ed19b6383da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.148677:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787782996.149073:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1d359f7/0x6d98ed19b6383c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149083:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a057e00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.149088:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d359f7/0x6d98ed19b6383c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149127:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1d359f7/0x6d98ed19b6383c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149147:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1d359f7/0x6d98ed19b6383c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149171:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1d359f7/0x6d98ed19b6383c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149195:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787782996.149199:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003547e954/0x6d98ed19b6383cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149205:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a057a00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.149208:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003547e954/0x6d98ed19b6383cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149216:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003547e954/0x6d98ed19b6383cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149226:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003547e954/0x6d98ed19b6383cc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149233:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003547e954/0x6d98ed19b6383cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149244:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787782996.149247:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010729115/0x6d98ed19b6383d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149252:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a056800 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.149261:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010729115/0x6d98ed19b6383d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149269:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010729115/0x6d98ed19b6383d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149279:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010729115/0x6d98ed19b6383d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149286:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010729115/0x6d98ed19b6383d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149299:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782996.149302:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054108510/0x6d98ed19b6383da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149308:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a056c00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.149312:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054108510/0x6d98ed19b6383da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149319:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054108510/0x6d98ed19b6383da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149329:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054108510/0x6d98ed19b6383da lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149335:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054108510/0x6d98ed19b6383da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.149355:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782996.149357:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782996.149359:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782996.151063:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.151073:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4957dac/0x6d98ed19b6383e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.151119:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.151124:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.151131:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4957dac/0x6d98ed19b6383e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.151145:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4957dac/0x6d98ed19b6383e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.151155:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4957dac/0x6d98ed19b6383e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.151163:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4957dac/0x6d98ed19b6383e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.151183:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787782996.151936:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.151943:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9cdf8d/0x6d98ed19b6383e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.151955:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.151959:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.151964:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9cdf8d/0x6d98ed19b6383e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.151976:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae9cdf8d/0x6d98ed19b6383e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.151995:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787782996.151997:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae9cdf8d/0x6d98ed19b6383e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.152005:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4957dac/0x6d98ed19b6383e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.152008:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae9cdf8d/0x6d98ed19b6383e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.152027:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a056000 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787782996.152030:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782996.152034:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4957dac/0x6d98ed19b6383e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.152045:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4957dac/0x6d98ed19b6383e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.152064:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4957dac/0x6d98ed19b6383e1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.152072:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4957dac/0x6d98ed19b6383e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.152133:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782996.152138:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae9cdf8d/0x6d98ed19b6383e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.152144:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a057400 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.152148:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9cdf8d/0x6d98ed19b6383e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.152163:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae9cdf8d/0x6d98ed19b6383e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.152174:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae9cdf8d/0x6d98ed19b6383e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.152182:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae9cdf8d/0x6d98ed19b6383e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.152196:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782996.152198:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782996.152200:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787782996.154324:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787782996.154337:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad60e161/0x6d98ed19b6383ef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.154362:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=480s v=(0 0) 00010000:00010000:3.0:1787782996.154367:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787782996.154375:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad60e161/0x6d98ed19b6383ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.154389:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad60e161/0x6d98ed19b6383ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.154399:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad60e161/0x6d98ed19b6383ef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.154406:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad60e161/0x6d98ed19b6383ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787782996.154438:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787782996.155132:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787782996.155141:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad60e161/0x6d98ed19b6383ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.155151:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a057000 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787782996.155156:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad60e161/0x6d98ed19b6383ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.155166:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad60e161/0x6d98ed19b6383ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.155185:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad60e161/0x6d98ed19b6383ef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.155207:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad60e161/0x6d98ed19b6383ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782996.155231:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782996.155233:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782996.155235:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787782996.156298:0:15014:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1787782996.156400:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cca9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14355:x1874625922441088:12345-0@lo:5:osp-pre-1-0.0 Request processed in 61471us (64003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782996.156410:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787782996.156632:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313ccaa940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14355:1874625922441088:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787782996.156649:0:14355:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1787782996.156706:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31346fda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14355:1874625922441216:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787782996.156877:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787782996.156917:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3129636e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787782996.158581:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922441216 00000100:00100000:1.0:1787782996.158594:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922441216 00000100:00100000:1.0:1787782996.158647:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787782996.158656:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14355:x1874625922441216:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787782996.158707:0:15012:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1787782996.161247:0:16032:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782996.161259:0:16032:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782996.161262:0:16032:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782996.163578:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b638363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782996.163599:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a1600 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787782996.163605:0:14319:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b638363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782996.163618:0:14319:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b638363 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782996.163643:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b638363 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782996.163652:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082013362/0x6d98ed19b638363 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782996.163680:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782996.163683:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782996.163685:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782996.173361:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346fde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14355:x1874625922441216:12345-0@lo:5:osp-pre-1-0.0 Request processed in 14699us (16476us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787782996.173373:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787782996.174663:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31346fda40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14355:1874625922441216:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787782996.174681:0:14355:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:3.0:1787782996.183836:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1787782996.392918:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787782997.242355:0:16093:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg215-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787782997.411889:0:16032:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787782998.434438:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787782999.458325:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787782999.719084:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782999.730934:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904617600 00000100:00100000:2.0:1787782999.730952:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904617600 00000100:00100000:2.0:1787782999.731016:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 74 00000100:00100000:2.0:1787782999.731027:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2348:x1874625904617600:12345-192.168.202.15@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787782999.731057:0:14324:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 74651f07-71e3-4eff-9766-b3b4d7b96d8f@192.168.202.15@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:2.0:1787782999.731842:0:14324:0:(genops.c:1385:class_connect()) connect: client 74651f07-71e3-4eff-9766-b3b4d7b96d8f, cookie 0x6d98ed19b6383f6 00000100:00080000:2.0:1787782999.731994:0:14324:0:(import.c:65:import_set_state_nolock()) ffff8c313d6e0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782999.732164:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+5:2348:x1874625904617600:12345-192.168.202.15@tcp:250:mount.lustre.0 Request processed in 1137us (13861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782999.732174:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 74 00000100:00100000:3.0:1787782999.741233:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782999.741351:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904617728 00000100:00100000:1.0:1787782999.741361:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904617728 00000100:00100000:1.0:1787782999.741421:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 75 00000100:00100000:1.0:1787782999.741431:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+5:13745:x1874625904617728:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787782999.741447:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782999.741464:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3102f45e00/0x6d98ed19b6383fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e569d expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782999.741493:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3102f45e00/0x6d98ed19b6383fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e569d expref: 6 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782999.741515:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3102f45e00/0x6d98ed19b6383fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e569d expref: 6 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782999.741524:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3102f45e00, rc 0) 00000100:00100000:1.0:1787782999.741590:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+6:13745:x1874625904617728:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 160us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782999.741597:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 75 00000100:00100000:3.0:1787782999.744179:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782999.744234:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904617856 00000100:00100000:2.0:1787782999.744242:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904617856 00000100:00100000:2.0:1787782999.744295:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:2.0:1787782999.744305:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+6:13745:x1874625904617856:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787782999.745760:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+6:13745:x1874625904617856:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 1444us (1574us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787782999.745771:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 76 00000100:00100000:2.0:1787782999.749603:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782999.749827:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904617984 00000100:00100000:0.0:1787782999.749840:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904617984 00000100:00100000:0.0:1787782999.749903:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:0.0:1787782999.749913:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+6:13745:x1874625904617984:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787782999.750091:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787782999.750140:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141254e00/0x6d98ed19b638404 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e56a4 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782999.750169:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141254e00/0x6d98ed19b638404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e56a4 expref: 7 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782999.750181:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141254e00/0x6d98ed19b638404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e56a4 expref: 7 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787782999.750190:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254e00, rc 0) 00000100:00100000:0.0:1787782999.750255:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+7:13745:x1874625904617984:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 344us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782999.750262:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 77 00000100:00100000:3.0:1787782999.753489:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782999.754041:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904618112 00000100:00100000:2.0:1787782999.754051:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904618112 00000100:00100000:2.0:1787782999.754146:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 78 00000100:00100000:2.0:1787782999.754157:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+7:13745:x1874625904618112:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787782999.754448:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+8:13745:x1874625904618112:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 292us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782999.754456:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 78 00000100:00100000:3.0:1787782999.756496:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782999.756598:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904618240 00000100:00100000:0.0:1787782999.756609:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904618240 00000100:00100000:0.0:1787782999.756678:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:0.0:1787782999.756689:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+8:13745:x1874625904618240:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787782999.757335:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+8:13745:x1874625904618240:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 645us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782999.757343:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 79 00000100:00100000:1.0:1787782999.763336:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782999.764131:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904618368 00000100:00100000:0.0:1787782999.764144:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904618368 00000100:00100000:0.0:1787782999.764204:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:0.0:1787782999.764214:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+8:13763:x1874625904618368:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787782999.764513:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+8:13763:x1874625904618368:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 300us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782999.764529:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 80 00000100:00100000:3.0:1787782999.782274:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782999.782386:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904618496 00000100:00100000:2.0:1787782999.782396:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904618496 00000100:00100000:2.0:1787782999.782454:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:2.0:1787782999.782464:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+8:13763:x1874625904618496:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787782999.782811:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+8:13763:x1874625904618496:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 347us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782999.782819:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 81 00000100:00100000:3.0:1787782999.804138:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782999.804285:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904618624 00000100:00100000:1.0:1787782999.804296:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904618624 00000100:00100000:1.0:1787782999.804360:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:1.0:1787782999.804372:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+8:13745:x1874625904618624:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787782999.804392:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787782999.804410:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3102f44c00/0x6d98ed19b63840b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e56ce expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782999.804440:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3102f44c00/0x6d98ed19b63840b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e56ce expref: 9 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782999.804452:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3102f44c00/0x6d98ed19b63840b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e56ce expref: 9 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787782999.804462:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3102f44c00, rc 0) 00000100:00100000:1.0:1787782999.804566:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+9:13745:x1874625904618624:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 196us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782999.804574:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 82 00000100:00100000:1.0:1787782999.818868:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782999.819029:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904618752 00000100:00100000:0.0:1787782999.819040:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904618752 00000100:00100000:0.0:1787782999.819127:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 83 00000100:00100000:0.0:1787782999.819138:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+9:13745:x1874625904618752:12345-192.168.202.15@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787782999.819167:0:14323:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787782999.819193:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787782999.819198:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787782999.819201:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787782999.819203:0:14323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787782999.824265:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+9:13745:x1874625904618752:12345-192.168.202.15@tcp:256:mount.lustre.0 Request processed in 5105us (5383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782999.824283:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 83 00000100:00100000:3.0:1787782999.834472:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782999.834584:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904618880 00000100:00100000:2.0:1787782999.834595:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904618880 00000100:00100000:2.0:1787782999.834657:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:2.0:1787782999.834666:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+9:13745:x1874625904618880:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787782999.834693:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787782999.834713:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141205e00/0x6d98ed19b638412 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e56d5 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782999.834754:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141205e00/0x6d98ed19b638412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e56d5 expref: 10 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782999.834765:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141205e00/0x6d98ed19b638412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e56d5 expref: 10 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787782999.834774:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141205e00, rc 0) 00000100:00100000:2.0:1787782999.834881:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+10:13745:x1874625904618880:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 216us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782999.834903:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 84 00000100:00100000:2.0:1787782999.838270:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782999.838353:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904619008 00000100:00100000:0.0:1787782999.838363:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904619008 00000100:00100000:0.0:1787782999.838419:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:0.0:1787782999.838429:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+10:13745:x1874625904619008:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787782999.838784:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+10:13745:x1874625904619008:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 356us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782999.838800:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 85 00000100:00100000:3.0:1787782999.844268:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782999.844387:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904619136 00000100:00100000:1.0:1787782999.844477:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904619136 00000100:00100000:1.0:1787782999.844599:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:1.0:1787782999.844611:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cd2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+10:13745:x1874625904619136:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787782999.844929:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cd2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+10:13745:x1874625904619136:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 310us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782999.844938:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 86 00000100:00100000:3.0:1787782999.848853:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782999.849282:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904619264 00000100:00100000:2.0:1787782999.849301:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904619264 00000100:00100000:2.0:1787782999.849385:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:2.0:1787782999.849395:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+10:13768:x1874625904619264:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787782999.849685:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+10:13768:x1874625904619264:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 289us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782999.849693:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 87 00000100:00100000:2.0:1787782999.871421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787782999.871507:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904619392 00000100:00100000:1.0:1787782999.871518:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904619392 00000100:00100000:1.0:1787782999.871606:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:1.0:1787782999.871616:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+10:13768:x1874625904619392:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787782999.871907:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+10:13768:x1874625904619392:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 292us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782999.871928:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 88 00000100:00100000:3.0:1787782999.876481:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782999.877133:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904619520 00000100:00100000:0.0:1787782999.877144:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904619520 00000100:00100000:0.0:1787782999.877251:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:0.0:1787782999.877261:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cca8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2348:x1874625904619520:12345-192.168.202.15@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787782999.877299:0:14331:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from edb74ad9-50d8-46ec-9312-651fb814f467@192.168.202.15@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1787782999.877368:0:14331:0:(genops.c:1385:class_connect()) connect: client edb74ad9-50d8-46ec-9312-651fb814f467, cookie 0x6d98ed19b638419 00000004:00100000:0.0:1787782999.877398:0:14331:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787782999.877405:0:14331:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787782999.926412:0:14331:0:(import.c:65:import_set_state_nolock()) ffff8c3001ddd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787782999.926542:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cca8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+6:2348:x1874625904619520:12345-192.168.202.15@tcp:38:mount.lustre.0 Request processed in 49279us (50070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787782999.926553:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:3.0:1787782999.930547:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782999.930676:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904619648 00000100:00100000:2.0:1787782999.930693:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904619648 00000100:00100000:2.0:1787782999.930952:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:2.0:1787782999.930964:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+6:0:x1874625904619648:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787782999.931012:0:14332:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787782999.931138:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+6:0:x1874625904619648:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 176us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782999.931146:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:2.0:1787782999.933005:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787782999.933124:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904619776 00000100:00100000:3.0:1787782999.933133:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904619776 00000100:00100000:3.0:1787782999.933178:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:3.0:1787782999.933186:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31346ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+6:13745:x1874625904619776:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787782999.933212:0:14330:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787782999.933281:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31346ff840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+6:13745:x1874625904619776:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 95us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787782999.933289:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00080000:1.0:1787782999.934407:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787782999.939422:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782999.939553:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904619904 00000100:00100000:2.0:1787782999.939563:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904619904 00000100:00100000:2.0:1787782999.939990:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:2.0:1787782999.940003:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+6:13745:x1874625904619904:12345-192.168.202.15@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787782999.940162:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+6:13745:x1874625904619904:12345-192.168.202.15@tcp:40:mount.lustre.0 Request processed in 162us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782999.940187:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:2.0:1787782999.945483:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782999.947467:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787782999.947510:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787782999.947728:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904620032 00000100:00100000:2.0:1787782999.947739:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904620032 00000100:00100000:2.0:1787782999.947809:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904620160 00000100:00100000:2.0:1787782999.947813:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904620160 00000100:00100000:2.0:1787782999.947839:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:2.0:1787782999.947847:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1874625904620032:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787782999.947881:0:15014:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from edb74ad9-50d8-46ec-9312-651fb814f467@192.168.202.15@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:2.0:1787782999.947914:0:15014:0:(genops.c:1385:class_connect()) connect: client edb74ad9-50d8-46ec-9312-651fb814f467, cookie 0x6d98ed19b638420 00002000:00100000:2.0:1787782999.947936:0:15014:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli edb74ad9-50d8-46ec-9312-651fb814f467/ffff8c3133fc3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113937 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787782999.947962:0:15014:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787782999.948352:0:15014:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787782999.948383:0:15014:0:(import.c:65:import_set_state_nolock()) ffff8c3133fc4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782999.948454:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:edb74ad9-50d8-46ec-9312-651fb814f467+6:2348:x1874625904620032:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 607us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782999.948463:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:2.0:1787782999.948485:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:2.0:1787782999.948490:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1874625904620160:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787782999.948506:0:15014:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from edb74ad9-50d8-46ec-9312-651fb814f467@192.168.202.15@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:2.0:1787782999.948534:0:15014:0:(genops.c:1385:class_connect()) connect: client edb74ad9-50d8-46ec-9312-651fb814f467, cookie 0x6d98ed19b638427 00002000:00100000:2.0:1787782999.948541:0:15014:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli edb74ad9-50d8-46ec-9312-651fb814f467/ffff8c3141f60800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113937 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787782999.948557:0:15014:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787782999.948698:0:15014:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787782999.948720:0:15014:0:(import.c:65:import_set_state_nolock()) ffff8c3141f65800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787782999.948759:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:edb74ad9-50d8-46ec-9312-651fb814f467+6:2348:x1874625904620160:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 266us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787782999.948765:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:1.0:1787782999.952122:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904620288 00000100:00100000:1.0:1787782999.952138:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904620288 00000100:00100000:1.0:1787782999.952191:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:1.0:1787782999.952201:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:edb74ad9-50d8-46ec-9312-651fb814f467+6:13745:x1874625904620288:12345-192.168.202.15@tcp:33:mount.lustre.0 00000004:00080000:1.0:1787782999.955050:0:14333:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2775us 00000004:00200000:1.0:1787782999.971319:0:14333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787782999.971550:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:edb74ad9-50d8-46ec-9312-651fb814f467+6:13745:x1874625904620288:12345-192.168.202.15@tcp:33:mount.lustre.0 Request processed in 19343us (26072us total) trans 0 rc 0/0 00000100:00100000:1.0:1787782999.971561:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:0.0:1787783000.129464:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783000.129597:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904620416 00000100:00100000:3.0:1787783000.129610:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904620416 00000100:00100000:3.0:1787783000.129697:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:3.0:1787783000.129709:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+6:13790:x1874625904620416:12345-192.168.202.15@tcp:101:mkdir.0 00010000:00010000:3.0:1787783000.129737:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787783000.130015:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b63842e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e56ff expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783000.130152:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056e00/0x6d98ed19b638435 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783000.130171:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056e00/0x6d98ed19b638435 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783000.130190:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056e00/0x6d98ed19b638435 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787783000.130477:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787783000.130483:0:14330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787783000.130754:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056e00/0x6d98ed19b638435 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783000.130915:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b63842e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e56ff expref: 8 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783000.130938:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056e00/0x6d98ed19b638435 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e56ff expref: 7 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783000.130948:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312161c100) 00010000:00010000:3.0:1787783000.130952:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787783000.130964:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312a056e00, rc 0) 00000100:00100000:3.0:1787783000.131218:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+7:13790:x1874625904620416:12345-192.168.202.15@tcp:101:mkdir.0 Request processed in 1510us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783000.131228:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00010000:00010000:0.0:1787783000.482499:0:16032:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787783001.186045:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922441600:0@lo:400:kworker.0 00000100:00100000:1.0:1787783001.186182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787783001.186270:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922442112:0@lo:400:kworker.0 00000100:00100000:1.0:1787783001.186306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787783001.186336:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787783001.186342:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c63e6d-1dfe-4772-affc-638938210ba4:3305:1874625922441472:0@lo:400:kworker.0 00000100:00100000:1.0:1787783001.186375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787783001.186402:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625922441984:0@lo:400:kworker.0 00000100:00100000:1.0:1787783001.186449:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787783001.186576:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922441472 00000100:00100000:1.0:1787783001.186586:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922441472 00000100:00100000:1.0:1787783001.186651:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787783001.186665:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+19:3305:x1874625922441472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787783001.186746:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+19:3305:x1874625922441472:12345-0@lo:400:kworker.0 Request processed in 84us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783001.186755:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787783001.186816:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c63e6d-1dfe-4772-affc-638938210ba4:3305:1874625922441472:0@lo:400:kworker.0 00000100:00100000:2.0:1787783001.186927:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922442112 00000100:00100000:2.0:1787783001.186934:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922442112 00000100:00100000:1.0:1787783001.186981:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922441600 00000100:00100000:1.0:1787783001.186986:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922441600 00000100:00100000:3.0:1787783001.187060:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922441344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787783001.187123:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783001.187151:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922441856:0@lo:400:kworker.0 00000100:00100000:0.0:1787783001.187165:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31411d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922441728:0@lo:400:kworker.0 00000100:00100000:3.0:1787783001.187180:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787783001.187211:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787783001.187237:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922442240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787783001.187265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787783001.187303:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922441728 00000100:00100000:0.0:1787783001.187307:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922441728 00000100:00100000:2.0:1787783001.187444:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922441344 00000100:00100000:2.0:1787783001.187449:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922441344 00000100:00100000:2.0:1787783001.187485:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922442240 00000100:00100000:2.0:1787783001.187489:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922442240 00000100:00100000:2.0:1787783001.187779:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787783001.187793:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccaa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1874625922441344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787783001.187822:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787783001.187892:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccaa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3307:x1874625922441344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783001.187900:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787783001.187921:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787783001.187929:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874625922442240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787783001.187943:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787783001.188139:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874625922442240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 210us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783001.188148:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787783001.188205:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922441344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787783001.188220:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922441984 00000100:00100000:2.0:1787783001.188227:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922441984 00000100:00100000:1.0:1787783001.188863:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787783001.188873:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922441600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787783001.188937:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922441600:12345-0@lo:400:kworker.0 Request processed in 66us (2756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783001.188944:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787783001.188984:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922441600:0@lo:400:kworker.0 00000100:00100000:1.0:1787783001.189062:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922441856 00000100:00100000:1.0:1787783001.189067:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922441856 00000100:00100000:1.0:1787783001.189088:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787783001.189122:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31411d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922442112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787783001.189164:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31411d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922442112:12345-0@lo:400:kworker.0 Request processed in 70us (2857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783001.189172:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787783001.189185:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787783001.189191:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cca8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922441856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787783001.189228:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cca8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922441856:12345-0@lo:400:kworker.0 Request processed in 36us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783001.189234:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787783001.189266:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922441856:0@lo:400:kworker.0 00000100:00100000:1.0:1787783001.189295:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922442112:0@lo:400:kworker.0 00000100:00100000:1.0:1787783001.189334:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922442240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787783001.189517:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787783001.189529:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1874625922441728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787783001.189576:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1874625922441728:12345-0@lo:400:kworker.0 Request processed in 50us (2366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783001.189583:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787783001.189604:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787783001.189609:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787783001.189613:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787783001.189632:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922441728:0@lo:400:kworker.0 00000100:00100000:2.0:1787783001.201881:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787783001.201903:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625922441984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787783001.202058:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625922441984:12345-0@lo:400:kworker.0 Request processed in 161us (15608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783001.202082:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787783001.202464:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31411d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625922441984:0@lo:400:kworker.0 00000001:00100000:3.0:1787783001.297361:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of edb74ad9-50d8-46ec-9312-651fb814f467 00000001:00080000:2.0:1787783001.352803:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1787783001.352833:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787783001.352842:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of edb74ad9-50d8-46ec-9312-651fb814f467 00010000:00010000:0.0:1787783001.505323:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787783002.190539:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783002.190670:0:16030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904620544 00000100:00100000:1.0:1787783002.190687:0:16030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904620544 00000100:00080000:2.0:1787783002.190802:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787783002.190822:0:16030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:1.0:1787783002.190835:0:16030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cca8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+7:13842:x1874625904620544:12345-192.168.202.15@tcp:41:lfs.0 00000004:00000024:1.0:1787783002.190899:0:16030:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787783002.191046:0:16030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cca8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+7:13842:x1874625904620544:12345-192.168.202.15@tcp:41:lfs.0 Request processed in 213us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783002.191055:0:16030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:0.0:1787783002.194333:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783002.195218:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904620672 00000100:00100000:2.0:1787783002.195229:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904620672 00000100:00100000:2.0:1787783002.195317:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:2.0:1787783002.195329:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:edb74ad9-50d8-46ec-9312-651fb814f467+5:13842:x1874625904620672:12345-192.168.202.15@tcp:13:lfs.0 00002000:00000024:2.0:1787783002.195370:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787783002.195463:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:edb74ad9-50d8-46ec-9312-651fb814f467+5:13842:x1874625904620672:12345-192.168.202.15@tcp:13:lfs.0 Request processed in 137us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783002.195472:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00080000:0.0:1787783002.195545:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787783002.198306:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783002.198400:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904620800 00000100:00100000:2.0:1787783002.198409:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904620800 00000100:00100000:2.0:1787783002.198526:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:2.0:1787783002.198538:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:edb74ad9-50d8-46ec-9312-651fb814f467+5:13842:x1874625904620800:12345-192.168.202.15@tcp:13:lfs.0 00002000:00000024:2.0:1787783002.198577:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787783002.198680:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:edb74ad9-50d8-46ec-9312-651fb814f467+5:13842:x1874625904620800:12345-192.168.202.15@tcp:13:lfs.0 Request processed in 144us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783002.198689:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00080000:0.0:1787783002.206774:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787783002.429385:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783002.429499:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904620928 00000100:00100000:1.0:1787783002.429522:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904620928 00000100:00100000:1.0:1787783002.429583:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 90 00000100:00100000:1.0:1787783002.429593:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+10:13874:x1874625904620928:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787783002.429611:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787783002.429629:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3102f44e00/0x6d98ed19b63843c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e5706 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783002.429668:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3102f44e00/0x6d98ed19b63843c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5706 expref: 11 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783002.429681:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3102f44e00/0x6d98ed19b63843c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5706 expref: 11 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783002.429690:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3102f44e00, rc 0) 00000100:00100000:1.0:1787783002.429763:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+11:13874:x1874625904620928:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 171us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783002.429771:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 90 00000100:00100000:3.0:1787783002.442743:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783002.442958:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904621056 00000100:00100000:0.0:1787783002.442969:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904621056 00000100:00100000:0.0:1787783002.443027:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:0.0:1787783002.443037:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+11:13874:x1874625904621056:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787783002.443434:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+11:13874:x1874625904621056:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 397us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783002.443442:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 91 00000100:00100000:3.0:1787783002.447844:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783002.448476:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904621184 00000100:00100000:2.0:1787783002.448488:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904621184 00000100:00100000:2.0:1787783002.448553:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:2.0:1787783002.448578:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+11:13874:x1874625904621184:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787783002.449413:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+11:13874:x1874625904621184:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 834us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783002.449423:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 92 00000100:00100000:3.0:1787783002.456430:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783002.465767:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904621312 00000100:00100000:1.0:1787783002.465791:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904621312 00000100:00100000:1.0:1787783002.465870:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 93 00000100:00100000:1.0:1787783002.465881:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+11:13882:x1874625904621312:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787783002.467451:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+11:13882:x1874625904621312:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 1564us (12261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783002.467464:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 93 00000100:00100000:3.0:1787783002.494266:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783002.494361:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904621440 00000100:00100000:0.0:1787783002.494371:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904621440 00000100:00100000:0.0:1787783002.494432:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 94 00000100:00100000:0.0:1787783002.494443:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+11:13882:x1874625904621440:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787783002.495062:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+11:13882:x1874625904621440:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 620us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783002.495388:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 94 00000100:00100000:3.0:1787783002.506171:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783002.506505:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904621568 00000100:00100000:1.0:1787783002.506522:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904621568 00000100:00100000:1.0:1787783002.506586:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 95 00000100:00100000:1.0:1787783002.506598:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+11:13874:x1874625904621568:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787783002.506633:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787783002.506667:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3102f45800/0x6d98ed19b638443 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e5730 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783002.506700:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3102f45800/0x6d98ed19b638443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5730 expref: 12 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783002.506712:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3102f45800/0x6d98ed19b638443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5730 expref: 12 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783002.506740:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3102f45800, rc 0) 00000100:00100000:1.0:1787783002.507868:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+12:13874:x1874625904621568:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 1266us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783002.507880:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 95 00000100:00100000:3.0:1787783002.514836:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783002.515371:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904621696 00000100:00100000:2.0:1787783002.515400:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904621696 00000100:00100000:2.0:1787783002.515509:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 96 00000100:00100000:2.0:1787783002.515550:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+12:13874:x1874625904621696:12345-192.168.202.15@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787783002.515609:0:14324:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787783002.515642:0:14324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787783002.515647:0:14324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787783002.515650:0:14324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787783002.515663:0:14324:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787783002.518141:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+12:13874:x1874625904621696:12345-192.168.202.15@tcp:256:mount.lustre.0 Request processed in 2583us (3315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783002.518159:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 96 00000100:00100000:3.0:1787783002.521525:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783002.521790:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904621824 00000100:00100000:0.0:1787783002.521804:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904621824 00000100:00100000:0.0:1787783002.521875:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00100000:0.0:1787783002.521886:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+12:13874:x1874625904621824:12345-192.168.202.15@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787783002.521909:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787783002.521934:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141254600/0x6d98ed19b63844a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e5737 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783002.522334:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141254600/0x6d98ed19b63844a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5737 expref: 13 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783002.522349:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141254600/0x6d98ed19b63844a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5737 expref: 13 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783002.522360:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254600, rc 0) 00000100:00100000:0.0:1787783002.522447:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:13874:x1874625904621824:12345-192.168.202.15@tcp:101:mount.lustre.0 Request processed in 563us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783002.522455:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 97 00000100:00100000:3.0:1787783002.527086:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783002.527312:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904621952 00000100:00100000:1.0:1787783002.527325:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904621952 00000100:00100000:1.0:1787783002.527404:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 98 00000100:00100000:1.0:1787783002.527416:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:13874:x1874625904621952:12345-192.168.202.15@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787783002.527821:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:13874:x1874625904621952:12345-192.168.202.15@tcp:501:mount.lustre.0 Request processed in 405us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783002.527830:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 98 00010000:00010000:1.0:1787783002.529380:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787783002.530895:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783002.531816:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904622080 00000100:00100000:1.0:1787783002.531831:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904622080 00000100:00100000:1.0:1787783002.531977:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:1.0:1787783002.531988:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:13874:x1874625904622080:12345-192.168.202.15@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787783002.532400:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:13874:x1874625904622080:12345-192.168.202.15@tcp:503:mount.lustre.0 Request processed in 412us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783002.532410:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 99 00000100:00100000:3.0:1787783002.540359:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783002.540826:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904622208 00000100:00100000:0.0:1787783002.540840:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904622208 00000100:00100000:0.0:1787783002.540919:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 100 00000100:00100000:0.0:1787783002.540932:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:13886:x1874625904622208:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787783002.541339:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:13886:x1874625904622208:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 409us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783002.541348:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 100 00000100:00100000:3.0:1787783002.549242:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783002.549679:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904622336 00000100:00100000:1.0:1787783002.549693:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904622336 00000100:00100000:1.0:1787783002.549776:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:1.0:1787783002.549788:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:13886:x1874625904622336:12345-192.168.202.15@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787783002.550172:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:13886:x1874625904622336:12345-192.168.202.15@tcp:502:llog_process_th.0 Request processed in 384us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783002.550181:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 101 00000100:00100000:3.0:1787783002.554710:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783002.554771:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783002.554808:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783002.555007:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904622848 00000100:00100000:2.0:1787783002.555020:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904622848 00000100:00100000:2.0:1787783002.555139:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:2.0:1787783002.555151:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+7:2352:x1874625904622848:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787783002.555254:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccaa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+7:2352:x1874625904622848:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 105us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783002.555263:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:0.0:1787783002.557432:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904622976 00000100:00100000:0.0:1787783002.557452:0:15495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904622976 00000100:00100000:0.0:1787783002.557520:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904623104 00000100:00100000:0.0:1787783002.557524:0:15495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904623104 00000100:00100000:3.0:1787783002.557828:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:3.0:1787783002.557843:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccaa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:edb74ad9-50d8-46ec-9312-651fb814f467+5:2352:x1874625904622976:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787783002.557962:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccaa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:edb74ad9-50d8-46ec-9312-651fb814f467+5:2352:x1874625904622976:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 123us (3267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783002.557970:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:3.0:1787783002.557995:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:3.0:1787783002.558002:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:edb74ad9-50d8-46ec-9312-651fb814f467+5:2352:x1874625904623104:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787783002.558036:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:edb74ad9-50d8-46ec-9312-651fb814f467+5:2352:x1874625904623104:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 35us (3227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783002.558042:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:2.0:1787783002.561384:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783002.562523:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904622464 00000100:00100000:3.0:1787783002.562543:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904622464 00000100:00100000:3.0:1787783002.562642:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:3.0:1787783002.562843:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1874625904622464:12345-192.168.202.15@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787783002.563075:0:14330:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 9a896bb7-a218-4158-9e10-c8ec78332a42@192.168.202.15@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:3.0:1787783002.563189:0:14330:0:(genops.c:1385:class_connect()) connect: client 9a896bb7-a218-4158-9e10-c8ec78332a42, cookie 0x6d98ed19b638451 00000004:00100000:3.0:1787783002.563233:0:14330:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787783002.566836:0:14330:0:(import.c:65:import_set_state_nolock()) ffff8c30032bd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787783002.567026:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a896bb7-a218-4158-9e10-c8ec78332a42+6:2348:x1874625904622464:12345-192.168.202.15@tcp:38:mount.lustre.0 Request processed in 4366us (5646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783002.567042:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:3.0:1787783002.572553:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783002.572674:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783002.576236:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904622720 00000100:00100000:2.0:1787783002.576257:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904622720 00000100:00100000:2.0:1787783002.576382:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904622592 00000100:00100000:2.0:1787783002.576386:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904622592 00000100:00100000:2.0:1787783002.576422:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:2.0:1787783002.576434:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cca92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+7:13874:x1874625904622720:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787783002.576494:0:14331:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787783002.576611:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cca92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+7:13874:x1874625904622720:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 178us (4073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783002.576620:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:2.0:1787783002.576641:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:2.0:1787783002.576648:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+6:0:x1874625904622592:12345-192.168.202.15@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787783002.576660:0:14331:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787783002.576684:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+6:0:x1874625904622592:12345-192.168.202.15@tcp:41:mount.lustre.0 Request processed in 36us (4009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783002.576690:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00080000:1.0:1787783002.577077:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787783002.583317:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783002.584160:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904623232 00000100:00100000:2.0:1787783002.584177:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904623232 00000100:00100000:2.0:1787783002.584260:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:2.0:1787783002.584271:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+6:13874:x1874625904623232:12345-192.168.202.15@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787783002.584395:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+6:13874:x1874625904623232:12345-192.168.202.15@tcp:40:mount.lustre.0 Request processed in 125us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783002.584404:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:2.0:1787783002.593040:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783002.594748:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783002.594835:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783002.595202:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904623360 00000100:00100000:1.0:1787783002.595216:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904623360 00000100:00100000:1.0:1787783002.595271:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904623488 00000100:00100000:1.0:1787783002.595275:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904623488 00000100:00100000:1.0:1787783002.595303:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:1.0:1787783002.595313:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1874625904623360:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787783002.595357:0:15013:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 9a896bb7-a218-4158-9e10-c8ec78332a42@192.168.202.15@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:1.0:1787783002.595402:0:15013:0:(genops.c:1385:class_connect()) connect: client 9a896bb7-a218-4158-9e10-c8ec78332a42, cookie 0x6d98ed19b638458 00002000:00100000:1.0:1787783002.595418:0:15013:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9a896bb7-a218-4158-9e10-c8ec78332a42/ffff8c31061ef000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113937 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787783002.595434:0:15013:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787783002.595785:0:15013:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787783002.595827:0:15013:0:(import.c:65:import_set_state_nolock()) ffff8c31061ee000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787783002.596400:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+6:2348:x1874625904623360:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 1084us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783002.596410:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:1.0:1787783002.596439:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:1.0:1787783002.596445:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1874625904623488:12345-192.168.202.15@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787783002.596470:0:15013:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 9a896bb7-a218-4158-9e10-c8ec78332a42@192.168.202.15@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:1.0:1787783002.596497:0:15013:0:(genops.c:1385:class_connect()) connect: client 9a896bb7-a218-4158-9e10-c8ec78332a42, cookie 0x6d98ed19b63845f 00002000:00100000:1.0:1787783002.596505:0:15013:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9a896bb7-a218-4158-9e10-c8ec78332a42/ffff8c31061ed000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113937 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787783002.596514:0:15013:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787783002.597423:0:15013:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787783002.597461:0:15013:0:(import.c:65:import_set_state_nolock()) ffff8c3110772800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787783002.597522:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+6:2348:x1874625904623488:12345-192.168.202.15@tcp:8:mount.lustre.0 Request processed in 1074us (2685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783002.597533:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:0.0:1787783002.605770:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904623616 00000100:00100000:0.0:1787783002.605796:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904623616 00000100:00100000:0.0:1787783002.605922:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:0.0:1787783002.605935:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+6:13874:x1874625904623616:12345-192.168.202.15@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787783002.606408:0:14334:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787783002.606613:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+6:13874:x1874625904623616:12345-192.168.202.15@tcp:33:mount.lustre.0 Request processed in 678us (13586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783002.606623:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:3.0:1787783002.827407:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783002.827536:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904623744 00000100:00100000:0.0:1787783002.827552:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904623744 00000100:00100000:0.0:1787783002.827680:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:0.0:1787783002.827696:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a896bb7-a218-4158-9e10-c8ec78332a42+6:13907:x1874625904623744:12345-192.168.202.15@tcp:101:mkdir.0 00010000:00010000:0.0:1787783002.827738:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787783002.827770:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b638466 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5761 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783002.827861:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b63846d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783002.827877:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b63846d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783002.827890:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b63846d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787783002.828200:0:14332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787783002.828206:0:14332:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787783002.828297:0:14332:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b63846d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783002.828330:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254400/0x6d98ed19b638466 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5761 expref: 8 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783002.828365:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b63846d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5761 expref: 7 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783002.828373:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312161c100) 00010000:00010000:0.0:1787783002.828377:0:14332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787783002.828381:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255400, rc 0) 00000100:00100000:0.0:1787783002.828541:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a896bb7-a218-4158-9e10-c8ec78332a42+7:13907:x1874625904623744:12345-192.168.202.15@tcp:101:mkdir.0 Request processed in 849us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783002.828550:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00000040:00080000:1.0:1787783002.849899:0:14364:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787783003.553213:0:16032:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787783004.578022:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787783005.361152:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of edb74ad9-50d8-46ec-9312-651fb814f467 00000001:00100000:3.0:1787783005.361175:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9a896bb7-a218-4158-9e10-c8ec78332a42 00010000:00010000:3.0:1787783005.602809:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787783005.605272:0:16296:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1787783006.305607:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787783006.305644:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922442368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787783006.305748:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787783006.305845:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922442368 00000100:00100000:0.0:1787783006.305856:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922442368 00000100:00100000:0.0:1787783006.305924:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787783006.305934:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922442368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787783006.305981:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787783006.306034:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922442368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783006.306043:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787783006.306124:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922442368:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787783006.306213:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787783006.308796:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922442496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787783006.308896:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787783006.309288:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922442496 00000100:00100000:0.0:1787783006.309299:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922442496 00000100:00100000:0.0:1787783006.309390:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787783006.309400:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922442496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787783006.309442:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787783006.309501:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922442496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783006.309509:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787783006.309589:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787783006.309628:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787783006.309718:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c97f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922442496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787783006.310113:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922442752:0@lo:400:kworker.0 00000100:00100000:0.0:1787783006.310163:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787783006.310196:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787783006.310201:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922442880:0@lo:400:kworker.0 00000100:00100000:0.0:1787783006.310221:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787783006.310249:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922442752 00000100:00100000:0.0:1787783006.310253:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922442752 00000100:00100000:0.0:1787783006.310285:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922442880 00000100:00100000:0.0:1787783006.310287:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922442880 00000100:00100000:0.0:1787783006.310312:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787783006.310319:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922442752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787783006.310356:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874625922442752:12345-0@lo:400:kworker.0 Request processed in 38us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783006.310363:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787783006.310375:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787783006.310380:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922442880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787783006.310406:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874625922442880:12345-0@lo:400:kworker.0 Request processed in 26us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783006.310411:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787783006.310453:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874625922442880:0@lo:400:kworker.0 00000100:00100000:0.0:1787783006.310480:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874625922442752:0@lo:400:kworker.0 00000100:00080000:1.0:1787783006.310783:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787783006.310796:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922443008:0@lo:400:kworker.0 00000100:00100000:1.0:1787783006.310831:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787783006.310861:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787783006.310877:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c63e6d-1dfe-4772-affc-638938210ba4:3304:1874625922442624:0@lo:400:kworker.0 00000100:00100000:1.0:1787783006.310907:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787783006.311238:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922442624 00000100:00100000:1.0:1787783006.311243:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922442624 00000100:00100000:1.0:1787783006.311279:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787783006.311286:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e48fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+19:3304:x1874625922442624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787783006.311329:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e48fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+19:3304:x1874625922442624:12345-0@lo:400:kworker.0 Request processed in 43us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783006.311336:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787783006.311381:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c63e6d-1dfe-4772-affc-638938210ba4:3304:1874625922442624:0@lo:400:kworker.0 00000100:00100000:0.0:1787783006.311749:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922443008 00000100:00100000:0.0:1787783006.311754:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922443008 00000100:00100000:0.0:1787783006.311802:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787783006.311809:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922443008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787783006.311849:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922443008:12345-0@lo:400:kworker.0 Request processed in 42us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783006.311855:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787783006.311907:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787783006.312630:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922443008:0@lo:400:kworker.0 00000001:00100000:1.0:1787783006.416962:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9a896bb7-a218-4158-9e10-c8ec78332a42 00000001:00100000:2.0:1787783006.421752:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9a896bb7-a218-4158-9e10-c8ec78332a42 00010000:00010000:3.0:1787783006.635184:0:16032:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787783007.649508:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787783007.759363:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783007.759419:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783007.759453:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783007.759498:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783007.759630:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904624256 00000100:00100000:2.0:1787783007.759645:0:15495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904624256 00000100:00100000:2.0:1787783007.759735:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904624512 00000100:00100000:2.0:1787783007.759739:0:15495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904624512 00000100:00100000:2.0:1787783007.759767:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:2.0:1787783007.759779:0:15495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:edb74ad9-50d8-46ec-9312-651fb814f467+5:2351:x1874625904624256:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787783007.759879:0:15495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:edb74ad9-50d8-46ec-9312-651fb814f467+5:2351:x1874625904624256:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 102us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783007.759888:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:2.0:1787783007.759907:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:2.0:1787783007.759914:0:15495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a896bb7-a218-4158-9e10-c8ec78332a42+5:2351:x1874625904624512:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787783007.759940:0:15495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a896bb7-a218-4158-9e10-c8ec78332a42+5:2351:x1874625904624512:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 28us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783007.759947:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00080000:2.0:1787783007.759966:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787783007.759970:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787783007.760160:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904623872 00000100:00100000:0.0:1787783007.760166:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904623872 00000100:00100000:0.0:1787783007.760211:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 103 00000100:00100000:0.0:1787783007.760218:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:2351:x1874625904623872:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787783007.760248:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:2351:x1874625904623872:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 31us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783007.760255:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 103 00000100:00100000:0.0:1787783007.760315:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783007.760391:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783007.760414:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904624000 00000100:00100000:0.0:1787783007.760418:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904624000 00000100:00100000:0.0:1787783007.760450:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904624384 00000100:00100000:0.0:1787783007.760453:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904624384 00000100:00100000:0.0:1787783007.760475:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:0.0:1787783007.760501:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+6:2351:x1874625904624000:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787783007.760531:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+6:2351:x1874625904624000:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 33us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783007.760657:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:0.0:1787783007.760681:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:0.0:1787783007.760689:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a896bb7-a218-4158-9e10-c8ec78332a42+6:2351:x1874625904624384:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787783007.760717:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a896bb7-a218-4158-9e10-c8ec78332a42+6:2351:x1874625904624384:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 30us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783007.760724:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:0.0:1787783007.760775:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783007.762029:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904624128 00000100:00100000:2.0:1787783007.762048:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904624128 00000100:00100000:2.0:1787783007.762123:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904624640 00000100:00100000:2.0:1787783007.762126:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904624640 00000100:00100000:2.0:1787783007.762152:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:2.0:1787783007.762162:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:edb74ad9-50d8-46ec-9312-651fb814f467+5:2351:x1874625904624128:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787783007.762238:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:edb74ad9-50d8-46ec-9312-651fb814f467+5:2351:x1874625904624128:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 77us (1922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783007.762269:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:2.0:1787783007.762289:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:2.0:1787783007.762295:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a896bb7-a218-4158-9e10-c8ec78332a42+5:2351:x1874625904624640:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:2.0:1787783007.762323:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9a896bb7-a218-4158-9e10-c8ec78332a42+5:2351:x1874625904624640:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 29us (1548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783007.762330:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00080000:2.0:1787783007.762349:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787783007.762353:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787783007.762357:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787783008.680288:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787783008.863743:0:16445:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffffa9d8250 20000000:00000080:1.0:1787783008.863762:0:16445:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c30040f1000 uarg=0000000000000000 20000000:01000000:1.0:1787783008.863797:0:16445:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787783008.863804:0:16445:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787783008.863808:0:16445:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787783008.865307:0:16446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1787783008.865720:0:16445:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787783008.874402:0:16445:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787783008.874504:0:16445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c3102f45200/0x6d98ed19b638474 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783008.874525:0:16445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3141255200/0x6d98ed19b638164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b63815d expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783008.874533:0:16445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31013a0000/0x6d98ed19b6381b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6381aa expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783008.874559:0:16445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c31013a1e00/0x6d98ed19b6382ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6382e5 expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783008.874568:0:16445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3141205e00/0x6d98ed19b638412 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e56d5 expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783008.874575:0:16445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c3141254600/0x6d98ed19b63844a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5737 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783008.874582:0:16445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c3102f45200/0x6d98ed19b638474 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783008.874700:0:16445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3141254600/0x6d98ed19b63844a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5737 expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783008.874717:0:16445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c3141254600/0x6d98ed19b63844a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5737 expref: 12 pid: 14323 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783008.874733:0:16445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1874625922443136:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787783008.874908:0:16445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3141205e00/0x6d98ed19b638412 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e56d5 expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783008.874918:0:16445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c3141205e00/0x6d98ed19b638412 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e56d5 expref: 12 pid: 14324 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783008.874927:0:16445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1874625922443264:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787783008.874960:0:16445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31013a1e00/0x6d98ed19b6382ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b6382e5 expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783008.874979:0:16445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c31013a1e00/0x6d98ed19b6382ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b6382e5 expref: 18 pid: 14323 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783008.874988:0:16445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1874625922443392:0@lo:104: 00000100:00100000:1.0:1787783008.875033:0:16445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787783008.875079:0:16445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c31013a0000/0x6d98ed19b6381b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b6381aa expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783008.875087:0:16445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c31013a0000/0x6d98ed19b6381b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b6381aa expref: 18 pid: 14323 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783008.875134:0:16445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1874625922443520:0@lo:104: 00000100:00100000:1.0:1787783008.875160:0:16445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787783008.875186:0:16445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c3141255200/0x6d98ed19b638164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6d98ed19b63815d expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783008.875193:0:16445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c3141255200/0x6d98ed19b638164 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6d98ed19b63815d expref: 18 pid: 14324 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783008.875201:0:16445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1874625922443648:0@lo:104: 00000100:00100000:1.0:1787783008.875225:0:16445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787783008.875247:0:16445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3108bb0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787783008.875380:0:14313:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787783008.875394:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922443392 00000100:00100000:2.0:1787783008.875400:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922443392 00000100:00100000:2.0:1787783008.875447:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922443520 00000100:00100000:2.0:1787783008.875450:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922443520 00000100:00100000:2.0:1787783008.875461:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922443648 00000100:00100000:2.0:1787783008.875464:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922443648 00000100:00100000:2.0:1787783008.875475:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787783008.875483:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c63e6d-1dfe-4772-affc-638938210ba4+5:16445:x1874625922443392:12345-0@lo:104: 00010000:00010000:2.0:1787783008.875494:0:14313:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c3102f44a00/0x6d98ed19b6382e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b6382ec expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.875552:0:14313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787783008.875558:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c63e6d-1dfe-4772-affc-638938210ba4+5:16445:x1874625922443392:12345-0@lo:104: Request processed in 75us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783008.875566:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787783008.875582:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787783008.875606:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c63e6d-1dfe-4772-affc-638938210ba4+4:16445:x1874625922443520:12345-0@lo:104: 00010000:00010000:2.0:1787783008.875614:0:14313:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c3140cc7000/0x6d98ed19b6381aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b6381b1 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.875650:0:14313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787783008.875655:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c63e6d-1dfe-4772-affc-638938210ba4+4:16445:x1874625922443520:12345-0@lo:104: Request processed in 60us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783008.875673:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787783008.875687:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787783008.875692:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c63e6d-1dfe-4772-affc-638938210ba4+3:16445:x1874625922443648:12345-0@lo:104: 00010000:00010000:2.0:1787783008.875699:0:14313:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b63815d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b638164 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.875728:0:14313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787783008.875732:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:48c63e6d-1dfe-4772-affc-638938210ba4+3:16445:x1874625922443648:12345-0@lo:104: Request processed in 41us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783008.875737:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787783008.875781:0:14319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787783008.875786:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3102f44a00/0x6d98ed19b6382e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b6382ec expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.875794:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3102f44a00 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:2.0:1787783008.875798:0:14319:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3102f44a00/0x6d98ed19b6382e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b6382ec expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.875806:0:14319:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3102f44a00/0x6d98ed19b6382e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b6382ec expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787783008.875813:0:14319:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3102f44a00/0x6d98ed19b6382e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b6382ec expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787783008.875825:0:14319:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787783008.875854:0:14319:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3102f44a00/0x6d98ed19b6382e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6382ec expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.875861:0:14319:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787783008.875880:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3102f44a00/0x6d98ed19b6382e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6382ec expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.875887:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3102f44a00/0x6d98ed19b6382e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6382ec expref: -99 pid: 15734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.875900:0:14319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787783008.875902:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c3140cc7000/0x6d98ed19b6381aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b6381b1 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.875908:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3140cc7000 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:2.0:1787783008.875911:0:14319:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c3140cc7000/0x6d98ed19b6381aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b6381b1 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.875917:0:14319:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c3140cc7000/0x6d98ed19b6381aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b6381b1 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787783008.875923:0:14319:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c3140cc7000/0x6d98ed19b6381aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b6381b1 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787783008.875929:0:14319:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787783008.875941:0:14319:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c3140cc7000/0x6d98ed19b6381aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6381b1 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.875946:0:14319:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787783008.875968:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c3140cc7000/0x6d98ed19b6381aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6381b1 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.875975:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c3140cc7000/0x6d98ed19b6381aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b6381b1 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.875983:0:14319:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787783008.875986:0:14319:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b63815d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6d98ed19b638164 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.875990:0:14319:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31013a0600 already unused, calling callback (ffffffffc1a18c20) 10000000:00010000:2.0:1787783008.875993:0:14319:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b63815d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6d98ed19b638164 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.875998:0:14319:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b63815d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6d98ed19b638164 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787783008.876003:0:14319:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b63815d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6d98ed19b638164 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787783008.876007:0:14319:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787783008.876017:0:14319:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b63815d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b638164 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.876022:0:14319:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787783008.876027:0:14319:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b63815d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b638164 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.876032:0:14319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.115@tcp lock: ffff8c31013a0600/0x6d98ed19b63815d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6d98ed19b638164 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.876043:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787783008.876049:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787783008.876050:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787783008.876066:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787783008.876077:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c63e6d-1dfe-4772-affc-638938210ba4:3304:1874625922443776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787783008.876130:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787783008.876158:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c63e6d-1dfe-4772-affc-638938210ba4:3306:1874625922443904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787783008.876180:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787783008.876196:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787783008.876201:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c63e6d-1dfe-4772-affc-638938210ba4:3306:1874625922444032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787783008.876225:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787783008.876802:0:16445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1874625922443392:0@lo:104: 00000100:00100000:1.0:1787783008.876812:0:16445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd2d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1874625922443520:0@lo:104: 00000100:00100000:1.0:1787783008.876819:0:16445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1874625922443648:0@lo:104: 00010000:00010000:3.0:1787783008.877198:0:16032:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787783008.877204:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787783008.877221:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922443776 00000100:00100000:3.0:1787783008.877225:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922443776 00010000:00010000:3.0:1787783008.877264:0:14317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31013a1e00/0x6d98ed19b6382ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b6382e5 expref: 19 pid: 14323 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783008.877280:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922443904 00000100:00100000:3.0:1787783008.877283:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922443904 00010000:00010000:3.0:1787783008.877292:0:14317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c31013a0000/0x6d98ed19b6381b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b6381aa expref: 20 pid: 14323 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783008.877301:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922444032 00000100:00100000:3.0:1787783008.877303:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922444032 00010000:00010000:3.0:1787783008.877312:0:14317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3141255200/0x6d98ed19b638164 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b63815d expref: 21 pid: 14324 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783008.877323:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787783008.877339:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c63e6d-1dfe-4772-affc-638938210ba4+21:3304:x1874625922443776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787783008.877350:0:14317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787783008.877357:0:14317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31013a1e00/0x6d98ed19b6382ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b6382e5 expref: 21 pid: 14323 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783008.877367:0:14317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31013a1e00/0x6d98ed19b6382ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b6382e5 expref: 21 pid: 14323 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783008.877382:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31013a1e00/0x6d98ed19b6382ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b6382e5 expref: 21 pid: 14323 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783008.877395:0:14317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787783008.877449:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c63e6d-1dfe-4772-affc-638938210ba4+20:3304:x1874625922443776:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783008.877465:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787783008.877482:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787783008.877488:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c63e6d-1dfe-4772-affc-638938210ba4+19:3306:x1874625922443904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787783008.877495:0:14317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787783008.877499:0:14317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c31013a0000/0x6d98ed19b6381b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b6381aa expref: 19 pid: 14323 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783008.877507:0:14317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c31013a0000/0x6d98ed19b6381b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b6381aa expref: 19 pid: 14323 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783008.877517:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c31013a0000/0x6d98ed19b6381b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b6381aa expref: 19 pid: 14323 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783008.877526:0:14317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787783008.877554:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c63e6d-1dfe-4772-affc-638938210ba4+18:3306:x1874625922443904:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783008.877560:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787783008.877571:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787783008.877576:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e58d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c63e6d-1dfe-4772-affc-638938210ba4+17:3306:x1874625922444032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787783008.877583:0:14317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787783008.877587:0:14317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3141255200/0x6d98ed19b638164 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6d98ed19b63815d expref: 17 pid: 14324 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783008.877604:0:14317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3141255200/0x6d98ed19b638164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6d98ed19b63815d expref: 17 pid: 14324 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783008.877613:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3141255200/0x6d98ed19b638164 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6d98ed19b63815d expref: 17 pid: 14324 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783008.877632:0:14317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787783008.877655:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e58d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:48c63e6d-1dfe-4772-affc-638938210ba4+16:3306:x1874625922444032:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783008.877670:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787783008.877727:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c63e6d-1dfe-4772-affc-638938210ba4:3306:1874625922444032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787783008.877735:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:48c63e6d-1dfe-4772-affc-638938210ba4:3306:1874625922443904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787783008.878001:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:48c63e6d-1dfe-4772-affc-638938210ba4:3304:1874625922443776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787783008.882376:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783008.882460:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783008.882550:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904624768 00000100:00100000:2.0:1787783008.882559:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904624768 00010000:00010000:2.0:1787783008.882599:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3141254600/0x6d98ed19b63844a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5737 expref: 13 pid: 14323 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783008.882634:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904624896 00000100:00100000:2.0:1787783008.882637:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904624896 00010000:00010000:2.0:1787783008.882649:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c3141205e00/0x6d98ed19b638412 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e56d5 expref: 14 pid: 14324 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783008.882673:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:2.0:1787783008.882682:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+14:2350:x1874625904624768:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787783008.882695:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787783008.882700:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3141254600/0x6d98ed19b63844a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5737 expref: 14 pid: 14323 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.882714:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3141254600/0x6d98ed19b63844a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5737 expref: 14 pid: 14323 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.882749:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787783008.882804:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+14:2350:x1874625904624768:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 123us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783008.882811:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:2.0:1787783008.882830:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:2.0:1787783008.882837:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:2350:x1874625904624896:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787783008.882844:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787783008.882848:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c3141205e00/0x6d98ed19b638412 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e56d5 expref: 13 pid: 14324 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.882856:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c3141205e00/0x6d98ed19b638412 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e56d5 expref: 13 pid: 14324 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.882867:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c3102f45200/0x6d98ed19b638474 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.882875:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3102f45200/0x6d98ed19b638474 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.882889:0:14315:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3102f45200/0x6d98ed19b638474 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.882894:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c3102f45200/0x6d98ed19b638474 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.882900:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c3102f45200/0x6d98ed19b638474 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.882907:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c3102f45200/0x6d98ed19b638474 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.882918:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3102f45200 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787783008.882922:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c3102f45200/0x6d98ed19b638474 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.882929:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c3102f45200/0x6d98ed19b638474 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.882937:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c3102f45200/0x6d98ed19b638474 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783008.882947:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787783008.882966:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:2350:x1874625904624896:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 130us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783008.882973:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00010000:00010000:1.0:1787783008.884707:0:16445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3141254600/0x6d98ed19b63844a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5737 expref: 12 pid: 14323 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783008.884745:0:16445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1874625922443136:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787783008.884780:0:16445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3141205e00/0x6d98ed19b638412 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e56d5 expref: 11 pid: 14324 timeout: 593 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783008.884789:0:16445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1874625922443264:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787783008.884831:0:16445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c3102f45200/0x6d98ed19b638474 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783008.884840:0:16445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c3102f45200/0x6d98ed19b638474 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783008.884846:0:16445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c3102f45200/0x6d98ed19b638474 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783008.884852:0:16445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c3102f45200/0x6d98ed19b638474 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783009.697383:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787783010.190755:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783010.190934:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904625024 00000100:00100000:1.0:1787783010.190949:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904625024 00000100:00100000:1.0:1787783010.191028:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 104 00000100:00100000:1.0:1787783010.191040:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+11:13759:x1874625904625024:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787783010.191065:0:14325:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787783010.191150:0:14325:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3102f45c00/0x6d98ed19b63847b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e5768 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783010.191193:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3102f45c00/0x6d98ed19b63847b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5768 expref: 12 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783010.191238:0:14325:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3102f45c00/0x6d98ed19b63847b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5768 expref: 12 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783010.191251:0:14325:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3102f45c00, rc 0) 00000100:00100000:1.0:1787783010.191351:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e087850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+12:13759:x1874625904625024:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 313us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783010.191360:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 104 00000100:00100000:3.0:1787783010.194645:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783010.194788:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904625152 00000100:00100000:2.0:1787783010.194802:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904625152 00000100:00100000:2.0:1787783010.194875:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 105 00000100:00100000:2.0:1787783010.194887:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+12:13759:x1874625904625152:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787783010.195609:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e084850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+12:13759:x1874625904625152:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 721us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783010.195621:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 105 00000100:00100000:3.0:1787783010.208743:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783010.209151:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904625280 00000100:00100000:1.0:1787783010.209165:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904625280 00000100:00100000:1.0:1787783010.209240:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 106 00000100:00100000:1.0:1787783010.209253:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+12:13759:x1874625904625280:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787783010.209533:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e084450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+12:13759:x1874625904625280:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 282us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783010.209542:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 106 00000100:00100000:0.0:1787783010.241279:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783010.241566:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904625408 00000100:00100000:2.0:1787783010.241591:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904625408 00000100:00100000:2.0:1787783010.241673:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 107 00000100:00100000:2.0:1787783010.241685:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+12:13759:x1874625904625408:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787783010.241709:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787783010.241751:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141205e00/0x6d98ed19b638482 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7f762009527e576f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783010.241794:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141205e00/0x6d98ed19b638482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e576f expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783010.241808:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141205e00/0x6d98ed19b638482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e576f expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783010.241820:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141205e00, rc 0) 00000100:00100000:2.0:1787783010.246306:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e086850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:13759:x1874625904625408:12345-192.168.202.15@tcp:101:ll_cfg_requeue.0 Request processed in 4602us (5022us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783010.246324:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 107 00000100:00100000:1.0:1787783010.273853:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783010.274208:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904625536 00000100:00100000:1.0:1787783010.274221:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904625536 00000100:00100000:1.0:1787783010.274294:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 108 00000100:00100000:1.0:1787783010.274306:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:13759:x1874625904625536:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787783010.279761:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e085450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:13759:x1874625904625536:12345-192.168.202.15@tcp:501:ll_cfg_requeue.0 Request processed in 5438us (5905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783010.279782:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 108 00000100:00100000:3.0:1787783010.284867:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783010.287005:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904625664 00000100:00100000:2.0:1787783010.287025:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904625664 00000100:00100000:2.0:1787783010.287506:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 109 00000100:00100000:2.0:1787783010.287527:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:13759:x1874625904625664:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787783010.288688:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e084c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:13759:x1874625904625664:12345-192.168.202.15@tcp:503:ll_cfg_requeue.0 Request processed in 1160us (3824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783010.288704:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 109 10000000:01000000:0.0:1787783010.337321:0:14327:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787783010.337333:0:14327:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3133fc1800 from 10 10000000:01000000:0.0:1787783010.337339:0:14327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787783010.337403:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255000/0x6d98ed19b638489 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783010.337417:0:14327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141255000/0x6d98ed19b638489 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783010.337431:0:14327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141255000/0x6d98ed19b638489 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787783010.337467:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922444160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787783010.337601:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787783010.337675:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31063a4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787783010.339947:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922444160 00000100:00100000:1.0:1787783010.339962:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922444160 00000100:00100000:1.0:1787783010.340032:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787783010.340062:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+16:14327:x1874625922444160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787783010.340085:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787783010.340124:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3102f44600/0x6d98ed19b638490 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b638489 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783010.340158:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3102f44600/0x6d98ed19b638490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b638489 expref: 17 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783010.340171:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3102f44600/0x6d98ed19b638490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b638489 expref: 17 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783010.340182:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3102f44600, rc 0) 00000100:00100000:1.0:1787783010.340287:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e085850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+17:14327:x1874625922444160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (2693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783010.340295:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787783010.340638:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922444160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787783010.340670:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141255000/0x6d98ed19b638489 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638490 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783010.340681:0:14327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141255000/0x6d98ed19b638489 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b638490 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783010.340775:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922444288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787783010.340813:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783010.340862:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787783010.340887:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922444288 00000100:00100000:3.0:1787783010.340891:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922444288 00000100:00100000:3.0:1787783010.340914:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787783010.340921:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+17:14327:x1874625922444288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787783010.341253:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e087450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+17:14327:x1874625922444288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 332us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783010.341409:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787783010.341444:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922444288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787783010.341476:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922444416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787783010.341517:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783010.341530:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787783010.341541:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922444416 00000100:00100000:3.0:1787783010.341544:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922444416 00000100:00100000:3.0:1787783010.341559:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787783010.341565:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+17:14327:x1874625922444416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787783010.341733:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e087050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+17:14327:x1874625922444416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783010.341740:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787783010.341776:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922444416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787783010.343704:0:16485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787783010.352393:0:14327:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787783010.352442:0:14327:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787783010.352458:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141255000/0x6d98ed19b638489 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638490 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783010.352474:0:14327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141255000/0x6d98ed19b638489 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b638490 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787783010.352489:0:14327:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787783010.352492:0:14327:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3107128000 from 10 10000000:01000000:3.0:1787783010.352496:0:14327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787783010.352556:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312a056600/0x6d98ed19b638497 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783010.352587:0:14327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c312a056600/0x6d98ed19b638497 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783010.352602:0:14327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c312a056600/0x6d98ed19b638497 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783010.352639:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922444544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787783010.352747:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783010.352814:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787783010.352886:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922444544 00000100:00100000:1.0:1787783010.352895:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922444544 00000100:00100000:1.0:1787783010.352965:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787783010.352976:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+17:14327:x1874625922444544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787783010.352992:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787783010.353009:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3102f45400/0x6d98ed19b63849e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b638497 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783010.353039:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3102f45400/0x6d98ed19b63849e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b638497 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783010.353051:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3102f45400/0x6d98ed19b63849e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b638497 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783010.353072:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3102f45400, rc 0) 00000100:00100000:1.0:1787783010.353147:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e086450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+18:14327:x1874625922444544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783010.353155:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787783010.353477:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922444544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787783010.353496:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c312a056600/0x6d98ed19b638497 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63849e expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783010.353507:0:14327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c312a056600/0x6d98ed19b638497 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b63849e expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783010.353576:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922444672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787783010.353606:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783010.353633:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787783010.353686:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922444672 00000100:00100000:1.0:1787783010.353691:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922444672 00000100:00100000:1.0:1787783010.353725:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787783010.353733:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+18:14327:x1874625922444672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787783010.354068:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:48c63e6d-1dfe-4772-affc-638938210ba4+18:14327:x1874625922444672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 334us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783010.354077:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787783010.354184:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922444672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787783010.354223:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cc8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922444800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787783010.354270:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783010.354296:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3106b9e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787783010.357756:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922444800 00000100:00100000:1.0:1787783010.357778:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922444800 00000100:00100000:1.0:1787783010.357861:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787783010.357873:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+18:14327:x1874625922444800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787783010.358238:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e085050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+18:14327:x1874625922444800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 367us (3967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783010.358248:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787783010.358312:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cc8b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922444800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787783010.368526:0:16488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787783010.369277:0:14327:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787783010.369315:0:14327:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787783010.369333:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c312a056600/0x6d98ed19b638497 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63849e expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783010.369348:0:14327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c312a056600/0x6d98ed19b638497 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b63849e expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787783010.369375:0:14327:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787783010.369379:0:14327:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c3129e3b800 from 10 10000000:01000000:2.0:1787783010.369382:0:14327:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787783010.369440:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141204a00/0x6d98ed19b6384a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783010.369448:0:14327:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.115@tcp lock: ffff8c3141204a00/0x6d98ed19b6384a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783010.369462:0:14327:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.115@tcp lock: ffff8c3141204a00/0x6d98ed19b6384a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783010.369496:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922444928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787783010.369597:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787783010.369673:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31052eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787783010.373077:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922444928 00000100:00100000:0.0:1787783010.373114:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922444928 00000100:00100000:0.0:1787783010.373190:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787783010.373204:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+18:14327:x1874625922444928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787783010.373230:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787783010.373253:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c3141254400/0x6d98ed19b6384ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6d98ed19b6384a5 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783010.373291:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c3141254400/0x6d98ed19b6384ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6d98ed19b6384a5 expref: 19 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783010.373304:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c3141254400/0x6d98ed19b6384ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6d98ed19b6384a5 expref: 19 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783010.373316:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254400, rc 0) 00000100:00100000:0.0:1787783010.373429:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e084050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+19:14327:x1874625922444928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (3832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783010.373438:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787783010.374162:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922444928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787783010.374188:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.115@tcp lock: ffff8c3141204a00/0x6d98ed19b6384a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6384ac expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783010.374200:0:14327:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.115@tcp lock: ffff8c3141204a00/0x6d98ed19b6384a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6d98ed19b6384ac expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783010.374304:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922445056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787783010.374354:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787783010.374397:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31052eacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787783010.374531:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922445056 00000100:00100000:0.0:1787783010.374537:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922445056 00000100:00100000:0.0:1787783010.374574:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787783010.374583:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+19:14327:x1874625922445056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787783010.374920:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e086050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+19:14327:x1874625922445056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 337us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783010.374937:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787783010.374982:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922445056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787783010.375023:0:14327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922445184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787783010.375143:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787783010.375167:0:14327:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31346c53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787783010.375178:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922445184 00000100:00100000:0.0:1787783010.375182:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922445184 00000100:00100000:0.0:1787783010.375199:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787783010.375206:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+19:14327:x1874625922445184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787783010.375370:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+19:14327:x1874625922445184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783010.375377:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787783010.375424:0:14327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:48c63e6d-1dfe-4772-affc-638938210ba4:14327:1874625922445184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787783010.380298:0:16491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787783010.380428:0:14327:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787783010.380457:0:14327:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.115@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787783010.380472:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.115@tcp lock: ffff8c3141204a00/0x6d98ed19b6384a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6384ac expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783010.380486:0:14327:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.115@tcp lock: ffff8c3141204a00/0x6d98ed19b6384a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6d98ed19b6384ac expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783010.725507:0:16032:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787783011.426056:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787783011.428224:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787783011.428264:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922445568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787783011.428381:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787783011.428486:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922445568 00000100:00100000:0.0:1787783011.428497:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922445568 00000100:00100000:0.0:1787783011.428589:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787783011.428599:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922445568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787783011.428663:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787783011.428721:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922445568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783011.428729:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787783011.428759:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787783011.428812:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922445568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787783011.430951:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c63e6d-1dfe-4772-affc-638938210ba4:3305:1874625922445440:0@lo:400:kworker.0 00000100:00100000:3.0:1787783011.431063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783011.431145:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922445312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787783011.431177:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783011.431221:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922445440 00000100:00100000:3.0:1787783011.431231:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922445440 00000100:00100000:3.0:1787783011.431285:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787783011.431295:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+19:3305:x1874625922445440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787783011.431354:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102ed9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:48c63e6d-1dfe-4772-affc-638938210ba4+19:3305:x1874625922445440:12345-0@lo:400:kworker.0 Request processed in 60us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783011.431362:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787783011.431406:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922445312 00000100:00100000:3.0:1787783011.431410:0:15015:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922445312 00000100:00100000:3.0:1787783011.431443:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787783011.431449:0:15015:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922445312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787783011.431483:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787783011.431533:0:15015:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922445312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783011.431540:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787783011.431558:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787783011.431585:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:48c63e6d-1dfe-4772-affc-638938210ba4:3305:1874625922445440:0@lo:400:kworker.0 00000100:00100000:3.0:1787783011.431606:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922445312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787783011.433747:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922445696:0@lo:400:kworker.0 00000100:00100000:1.0:1787783011.433841:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787783011.433930:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922445696 00000100:00100000:1.0:1787783011.433940:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922445696 00000100:00100000:1.0:1787783011.434009:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787783011.434020:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922445696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787783011.434283:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922445696:12345-0@lo:400:kworker.0 Request processed in 75us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783011.434294:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787783011.436160:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922445952:0@lo:400:kworker.0 00000100:00100000:0.0:1787783011.436250:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787783011.436303:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787783011.436309:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625922445824:0@lo:400:kworker.0 00000100:00100000:0.0:1787783011.436337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787783011.436377:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922445952 00000100:00100000:0.0:1787783011.436386:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922445952 00000100:00100000:0.0:1787783011.436446:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922445824 00000100:00100000:0.0:1787783011.436449:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922445824 00000100:00100000:0.0:1787783011.436475:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787783011.436485:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922445952:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787783011.436883:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787783011.439219:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874625922445952:12345-0@lo:400:kworker.0 Request processed in 2725us (2958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783011.439238:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787783011.439303:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787783011.439317:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625922445824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787783011.439364:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874625922445824:12345-0@lo:400:kworker.0 Request processed in 53us (3026us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783011.439385:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787783011.440031:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874625922445824:0@lo:400:kworker.0 00000100:00100000:3.0:1787783011.440059:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874625922445952:0@lo:400:kworker.0 00000100:00100000:1.0:1787783011.440413:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922445696:0@lo:400:kworker.0 00010000:00010000:3.0:1787783011.746009:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787783012.066521:0:14364:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787783012.722225:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783012.723060:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904625792 00000100:00100000:0.0:1787783012.723076:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904625792 00000100:00100000:0.0:1787783012.723224:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:0.0:1787783012.723237:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+6:14416:x1874625904625792:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787783012.723265:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787783012.723292:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b6384b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5776 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.723381:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6384ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.723398:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6384ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.723413:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6384ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.723430:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254800/0x6d98ed19b6384c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.723437:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254800/0x6d98ed19b6384c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.723698:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254800/0x6d98ed19b6384c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724248:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254a00/0x6d98ed19b6384c8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724260:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254a00/0x6d98ed19b6384c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724276:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254a00/0x6d98ed19b6384c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787783012.724361:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787783012.724366:0:14330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787783012.724479:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254a00/0x6d98ed19b6384c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787783012.724650:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787783012.724690:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6384ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724698:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6384ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724705:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6384ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724711:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787783012.724715:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6384ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724724:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6384ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724738:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312161c100) 00010000:00010000:0.0:1787783012.724740:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787783012.724752:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6384ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724759:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b6384ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724784:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254800/0x6d98ed19b6384c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724789:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254800/0x6d98ed19b6384c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724795:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254800/0x6d98ed19b6384c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724799:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141254800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787783012.724802:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254800/0x6d98ed19b6384c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724808:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254800/0x6d98ed19b6384c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724815:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8c310823c200) 00010000:00010000:0.0:1787783012.724817:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787783012.724820:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254800/0x6d98ed19b6384c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724826:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254800/0x6d98ed19b6384c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724874:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b6384b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5776 expref: 8 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724888:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254a00/0x6d98ed19b6384c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5776 expref: 7 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.724906:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c310823cc00) 00010000:00010000:0.0:1787783012.724908:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787783012.724911:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254a00, rc 0) 00000100:00100000:0.0:1787783012.725249:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+7:14416:x1874625904625792:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 2012us (3037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783012.725260:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:0.0:1787783012.730316:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783012.730466:0:16030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904626048 00000100:00100000:1.0:1787783012.730480:0:16030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904626048 00000100:00100000:1.0:1787783012.730763:0:16030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:1.0:1787783012.730776:0:16030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+7:14416:x1874625904626048:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787783012.730806:0:16030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787783012.730838:0:16030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b6384cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e577d expref: -99 pid: 16030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.730943:0:16030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b6384d6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.730975:0:16030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b6384d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.730992:0:16030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b6384d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.731230:0:16030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b6384dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.731255:0:16030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b6384dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.731268:0:16030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b6384dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.732416:0:16030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44800/0x6d98ed19b6384e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.732433:0:16030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44800/0x6d98ed19b6384e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.732693:0:16030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44800/0x6d98ed19b6384e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787783012.732708:0:16030:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787783012.733152:0:16030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b6384d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.733160:0:16030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b6384d6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.733168:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b6384d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.733174:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3102f44a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787783012.733178:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b6384d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.733186:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b6384d6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.733199:0:16030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c310823cc00) 00010000:00010000:1.0:1787783012.733203:0:16030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787783012.733207:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b6384d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.733224:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b6384d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.733238:0:16030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b6384dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.733244:0:16030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b6384dd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.733253:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b6384dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.733259:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3102f45200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787783012.733263:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b6384dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.733270:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b6384dd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.733283:0:16030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c31107b5500) 00010000:00010000:1.0:1787783012.733286:0:16030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787783012.733289:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b6384dd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.733296:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b6384dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.733993:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b6384cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e577d expref: 10 pid: 16030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.734012:0:16030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44800/0x6d98ed19b6384e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e577d expref: 9 pid: 16030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.734026:0:16030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c31107b5300) 00010000:00010000:1.0:1787783012.734029:0:16030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787783012.734032:0:16030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3102f44800, rc 0) 00000100:00100000:1.0:1787783012.734154:0:16030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+9:14416:x1874625904626048:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 3380us (3854us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787783012.734164:0:16030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:3.0:1787783012.739354:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783012.741014:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904626176 00000100:00100000:1.0:1787783012.741031:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904626176 00000100:00100000:1.0:1787783012.741127:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:1.0:1787783012.741138:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+9:14416:x1874625904626176:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787783012.741268:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+9:14416:x1874625904626176:12345-192.168.202.15@tcp:59:lhsmtool_posix.0 Request processed in 132us (1932us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783012.741276:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00010000:00010000:1.0:1787783012.774958:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787783012.777992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783012.778131:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904626304 00000100:00100000:2.0:1787783012.778144:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904626304 00000100:00100000:2.0:1787783012.778797:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:2.0:1787783012.778813:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+9:14422:x1874625904626304:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787783012.778841:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787783012.778874:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b6384f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5784 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.778961:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6384f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.778978:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6384f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.778992:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6384f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779008:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b638500 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779015:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b638500 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779021:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b638500 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779403:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6384f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779414:0:14332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6384f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779421:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6384f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779439:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787783012.779444:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6384f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779452:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6384f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779467:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312161c100) 00010000:00010000:2.0:1787783012.779472:0:14332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787783012.779478:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6384f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779484:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6384f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779718:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b638500 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779726:0:14332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b638500 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779732:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b638500 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779737:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787783012.779740:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b638500 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779746:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b638500 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779765:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c3108738300) 00010000:00010000:2.0:1787783012.779768:0:14332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787783012.779771:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b638500 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779777:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b638500 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779818:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b6384f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5784 expref: 10 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779830:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312161c100) 00010000:00010000:2.0:1787783012.779833:0:14332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787783012.779837:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b6384f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5784 expref: 10 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.779846:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204c00, rc 0) 00000100:00100000:2.0:1787783012.779939:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+9:14422:x1874625904626304:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1131us (1962us total) trans 0 rc 301/301 00000100:00100000:2.0:1787783012.779949:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:2.0:1787783012.787390:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783012.787733:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904626432 00000100:00100000:1.0:1787783012.787747:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904626432 00000100:00100000:1.0:1787783012.787809:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:1.0:1787783012.787821:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:edb74ad9-50d8-46ec-9312-651fb814f467+9:14422:x1874625904626432:12345-192.168.202.15@tcp:700:lfs.0 00000100:00100000:1.0:1787783012.787940:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:edb74ad9-50d8-46ec-9312-651fb814f467+9:14422:x1874625904626432:12345-192.168.202.15@tcp:700:lfs.0 Request processed in 121us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783012.788015:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:3.0:1787783012.790426:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783012.790773:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904626688 00000100:00100000:1.0:1787783012.790787:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904626688 00000100:00100000:1.0:1787783012.790866:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 19 00000100:00100000:1.0:1787783012.790879:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+9:14422:x1874625904626688:12345-192.168.202.15@tcp:36:lfs.0 00010000:00010000:1.0:1787783012.790988:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787783012.791025:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056e00/0x6d98ed19b638435 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e56ff expref: 9 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.791052:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312161c100) 00010000:00010000:1.0:1787783012.791059:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787783012.791507:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b638507 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.791525:0:14331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b63846d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5761 expref: 5 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.791536:0:14331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b638507 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.791581:0:14331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b63846d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5761 expref: 5 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.791598:0:14331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b63846d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5761 expref: 5 pid: 14332 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783012.791615:0:14331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14331:1874625922446080:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787783012.791758:0:14331:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31061e09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787783012.795381:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783012.795554:0:14331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14331:1874625922446080:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787783012.795610:0:14331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b638507 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783012.795822:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904626816 00000100:00100000:2.0:1787783012.795832:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904626816 00010000:00010000:2.0:1787783012.795904:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b63846d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5761 expref: 6 pid: 14332 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783012.795953:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:2.0:1787783012.795965:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a896bb7-a218-4158-9e10-c8ec78332a42+6:2349:x1874625904626816:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787783012.796005:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787783012.796013:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b63846d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5761 expref: 6 pid: 14332 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.796027:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b63846d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5761 expref: 6 pid: 14332 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.796054:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b63846d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5761 expref: 6 pid: 14332 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.796071:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312161c100) 00010000:00010000:2.0:1787783012.796076:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b638507 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.796088:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b638507 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.796117:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b638507 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.796143:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787783012.796205:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc883c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9a896bb7-a218-4158-9e10-c8ec78332a42+5:2349:x1874625904626816:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 242us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783012.796214:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00010000:00010000:1.0:1787783012.796294:0:14331:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b638507 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.796309:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b638507 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.796341:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b63850e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.796353:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b63850e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.796363:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b63850e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787783012.797303:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1787783012.800534:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787783012.800559:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b638507 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.800572:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b638507 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.800582:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b638507 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.800590:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3102f44000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787783012.800595:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b638507 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.800605:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b638507 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.800637:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c312161c100) 00010000:00010000:1.0:1787783012.800641:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787783012.800657:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b638507 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.800664:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b638507 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787783012.800696:0:14331:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002e48473c reply state 00000000089037be transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b63850e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783012.800706:0:14331:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787783012.800861:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+10:14422:x1874625904626688:12345-192.168.202.15@tcp:36:lfs.0 Request processed in 9977us (10441us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787783012.800872:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 19 00010000:00010000:1.0:1787783012.806957:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b63850e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.806985:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b63850e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.806994:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b63850e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.807001:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3102f45200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787783012.807007:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b63850e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.807018:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b63850e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.807044:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c31107b5500) 00010000:00010000:1.0:1787783012.807047:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787783012.807052:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b63850e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.807079:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b63850e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783012.877531:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783012.877725:0:16030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904626944 00000100:00100000:1.0:1787783012.877745:0:16030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904626944 00000100:00100000:1.0:1787783012.877927:0:16030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:1.0:1787783012.877943:0:16030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+9:14430:x1874625904626944:12345-192.168.202.15@tcp:101:lctl.0 00000100:00100000:3.0:1787783012.877958:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:1.0:1787783012.877985:0:16030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1787783012.878012:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:1.0:1787783012.878022:0:16030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b638515 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e578b expref: -99 pid: 16030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783012.878044:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783012.878067:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783012.878152:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:1.0:1787783012.878162:0:16030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b63851c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.878184:0:16030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b63851c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.878200:0:16030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b63851c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783012.878208:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904627328 00000100:00100000:3.0:1787783012.878220:0:15495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904627328 00000100:00100000:3.0:1787783012.878276:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904627584 00000100:00100000:3.0:1787783012.878280:0:15495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904627584 00000004:00200000:1.0:1787783012.878289:0:16030:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787783012.878295:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904627200 00000004:00200000:1.0:1787783012.878296:0:16030:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000100:00100000:3.0:1787783012.878301:0:15495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904627200 00000100:00100000:3.0:1787783012.878315:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904627456 00000100:00100000:3.0:1787783012.878318:0:15495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904627456 00000100:00100000:3.0:1787783012.878336:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:3.0:1787783012.878348:0:15495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:edb74ad9-50d8-46ec-9312-651fb814f467+5:2349:x1874625904627328:12345-192.168.202.15@tcp:400:kworker.0 00000004:00010000:1.0:1787783012.878377:0:16030:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b63851c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.878426:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b638515 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e578b expref: 11 pid: 16030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783012.878435:0:15495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:edb74ad9-50d8-46ec-9312-651fb814f467+5:2349:x1874625904627328:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 84us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783012.878454:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00010000:00010000:1.0:1787783012.878463:0:16030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44000/0x6d98ed19b63851c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e578b expref: 10 pid: 16030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783012.878478:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:3.0:1787783012.878492:0:15495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a896bb7-a218-4158-9e10-c8ec78332a42+5:2349:x1874625904627584:12345-192.168.202.15@tcp:400:kworker.0 00010000:00010000:1.0:1787783012.878496:0:16030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c31107b5500) 00010000:00010000:1.0:1787783012.878502:0:16030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787783012.878507:0:16030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3102f44000, rc 0) 00000100:00100000:3.0:1787783012.878553:0:15495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a896bb7-a218-4158-9e10-c8ec78332a42+5:2349:x1874625904627584:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 63us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783012.878569:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:1.0:1787783012.878589:0:16030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+10:14430:x1874625904626944:12345-192.168.202.15@tcp:101:lctl.0 Request processed in 633us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783012.878601:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:1.0:1787783012.878609:0:16030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 20 00000100:00100000:3.0:1787783012.878616:0:15495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:edb74ad9-50d8-46ec-9312-651fb814f467+5:2349:x1874625904627200:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:0.0:1787783012.878718:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904627072 00000100:00100000:0.0:1787783012.878723:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904627072 00000100:00100000:0.0:1787783012.878756:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:0.0:1787783012.878763:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:2349:x1874625904627072:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787783012.878998:0:15495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:edb74ad9-50d8-46ec-9312-651fb814f467+5:2349:x1874625904627200:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 385us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783012.879006:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:3.0:1787783012.879021:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787783012.879028:0:15495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a896bb7-a218-4158-9e10-c8ec78332a42+5:2349:x1874625904627456:12345-192.168.202.15@tcp:400:kworker.0 00000100:00080000:2.0:1787783012.879670:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787783012.879678:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787783012.882759:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102ed9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:2349:x1874625904627072:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 3980us (4796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783012.882774:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 120 00000100:00100000:3.0:1787783012.886156:0:15495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9a896bb7-a218-4158-9e10-c8ec78332a42+5:2349:x1874625904627456:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 7110us (7985us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783012.886175:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:3.0:1787783012.907916:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783012.908033:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904627712 00000100:00100000:0.0:1787783012.908048:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904627712 00000100:00100000:0.0:1787783012.908212:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:0.0:1787783012.908226:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a896bb7-a218-4158-9e10-c8ec78332a42+5:14431:x1874625904627712:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787783012.908249:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787783012.908271:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b638523 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5792 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.908345:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254800/0x6d98ed19b63852a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.908381:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254800/0x6d98ed19b63852a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.908392:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254800/0x6d98ed19b63852a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787783012.908448:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787783012.908451:0:14330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787783012.908472:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254800/0x6d98ed19b63852a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.908496:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b638523 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5792 expref: 7 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.908515:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254800/0x6d98ed19b63852a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5792 expref: 6 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.908523:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c31107b5500) 00010000:00010000:0.0:1787783012.908527:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787783012.908529:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254800, rc 0) 00000100:00100000:0.0:1787783012.908610:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a896bb7-a218-4158-9e10-c8ec78332a42+6:14431:x1874625904627712:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 387us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783012.908619:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 21 00000100:00100000:2.0:1787783012.910833:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783012.910950:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904627840 00000100:00100000:1.0:1787783012.910967:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904627840 00000100:00100000:1.0:1787783012.912723:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:1.0:1787783012.912736:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a896bb7-a218-4158-9e10-c8ec78332a42+6:14431:x1874625904627840:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787783012.912757:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787783012.912777:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b638531 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5799 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.912863:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b638538 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.912879:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b638538 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.912891:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b638538 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.912905:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45a00/0x6d98ed19b63853f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.912913:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45a00/0x6d98ed19b63853f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.912931:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45a00/0x6d98ed19b63853f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913131:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45600/0x6d98ed19b638546 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913140:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45600/0x6d98ed19b638546 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913147:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45600/0x6d98ed19b638546 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787783012.913190:0:14332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787783012.913194:0:14332:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787783012.913217:0:14332:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45600/0x6d98ed19b638546 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913229:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b638538 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913236:0:14332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b638538 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913243:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b638538 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913248:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3102f44a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787783012.913252:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b638538 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913260:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b638538 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913280:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c31107b5500) 00010000:00010000:1.0:1787783012.913283:0:14332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787783012.913288:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b638538 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913295:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f44a00/0x6d98ed19b638538 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913307:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45a00/0x6d98ed19b63853f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913313:0:14332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45a00/0x6d98ed19b63853f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913317:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45a00/0x6d98ed19b63853f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913322:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3102f45a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787783012.913325:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45a00/0x6d98ed19b63853f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913330:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45a00/0x6d98ed19b63853f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913336:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c31107b5c00) 00010000:00010000:1.0:1787783012.913338:0:14332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787783012.913341:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45a00/0x6d98ed19b63853f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913346:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45a00/0x6d98ed19b63853f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913389:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45200/0x6d98ed19b638531 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5799 expref: 8 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913403:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45600/0x6d98ed19b638546 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5799 expref: 7 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.913410:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c31107b5600) 00010000:00010000:1.0:1787783012.913412:0:14332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787783012.913415:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3102f45600, rc 0) 00000100:00100000:1.0:1787783012.913497:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a896bb7-a218-4158-9e10-c8ec78332a42+7:14431:x1874625904627840:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 763us (2681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783012.913505:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 22 00000100:00100000:3.0:1787783012.917270:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783012.917401:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904628096 00000100:00100000:1.0:1787783012.917414:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904628096 00000100:00100000:1.0:1787783012.917551:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:1.0:1787783012.917679:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+7:14431:x1874625904628096:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787783012.917713:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787783012.917743:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63854d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e57a0 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787783012.917910:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787783012.918355:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63854d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57a0 expref: 9 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.918374:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c31107b5500) 00010000:00010000:1.0:1787783012.918377:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787783012.918403:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63854d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57a0 expref: 9 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.918421:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31029f5600, rc 0) 00000100:00100000:1.0:1787783012.918691:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+8:14431:x1874625904628096:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 1127us (1434us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787783012.921725:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 23 00000100:00100000:2.0:1787783012.922186:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783012.922251:0:16030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904628352 00000100:00100000:1.0:1787783012.922265:0:16030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904628352 00000100:00100000:1.0:1787783012.922345:0:16030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:1.0:1787783012.922357:0:16030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a896bb7-a218-4158-9e10-c8ec78332a42+8:14431:x1874625904628352:12345-192.168.202.15@tcp:36:lfs.0 00010000:00010000:1.0:1787783012.922430:0:16030:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787783012.922468:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3102f45600/0x6d98ed19b638546 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5799 expref: 8 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.922557:0:16030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c31107b5600) 00010000:00010000:1.0:1787783012.922643:0:16030:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787783012.922683:0:16030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5400/0x6d98ed19b63855b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.922699:0:16030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5400/0x6d98ed19b63855b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783012.922711:0:16030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5400/0x6d98ed19b63855b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787783012.923307:0:16030:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072e1f346 reply state 00000000165c4a78 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5400/0x6d98ed19b63855b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783012.923318:0:16030:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787783012.923353:0:16030:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1787783012.923465:0:16030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a896bb7-a218-4158-9e10-c8ec78332a42+9:14431:x1874625904628352:12345-192.168.202.15@tcp:36:lfs.0 Request processed in 1109us (1288us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787783012.923474:0:16030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 24 00000100:00100000:2.0:1787783012.925847:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:3.0:1787783012.926174:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5400/0x6d98ed19b63855b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783012.926188:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5400/0x6d98ed19b63855b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783012.926196:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5400/0x6d98ed19b63855b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783012.926203:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f5400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787783012.926209:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5400/0x6d98ed19b63855b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783012.926225:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5400/0x6d98ed19b63855b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783012.926244:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c31107b5200) 00010000:00010000:3.0:1787783012.926247:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787783012.926253:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5400/0x6d98ed19b63855b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783012.926260:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5400/0x6d98ed19b63855b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783012.926834:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904628608 00000100:00100000:1.0:1787783012.926849:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904628608 00000100:00100000:1.0:1787783012.927035:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:1.0:1787783012.927048:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a896bb7-a218-4158-9e10-c8ec78332a42+8:14431:x1874625904628608:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787783012.927443:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a896bb7-a218-4158-9e10-c8ec78332a42+9:14431:x1874625904628608:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 396us (1609us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787783012.927453:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:3.0:1787783012.930258:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783012.930363:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904628864 00000100:00100000:0.0:1787783012.930375:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904628864 00000100:00100000:0.0:1787783012.930454:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:0.0:1787783012.930466:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a896bb7-a218-4158-9e10-c8ec78332a42+9:14431:x1874625904628864:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:0.0:1787783012.930506:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787783012.930550:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b638562 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e57a7 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.930669:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b638569 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.930687:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b638569 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.930699:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b638569 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.930719:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b638570 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.930727:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b638570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.930733:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b638570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787783012.930910:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787783012.931031:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b638569 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.931041:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b638569 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.931049:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b638569 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.931056:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255200 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787783012.931060:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b638569 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.931077:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b638569 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.931124:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c31107b5500) 00010000:00010000:0.0:1787783012.931128:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787783012.931135:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b638569 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.931142:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255200/0x6d98ed19b638569 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.931157:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b638570 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.931164:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b638570 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.931170:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b638570 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.931175:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:0.0:1787783012.931178:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b638570 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.931184:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b638570 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.931191:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c310823c200) 00010000:00010000:0.0:1787783012.931193:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787783012.931196:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b638570 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.931212:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255400/0x6d98ed19b638570 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.931264:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b638562 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57a7 expref: 11 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.931276:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c31107b5500) 00010000:00010000:0.0:1787783012.931279:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787783012.931282:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254600/0x6d98ed19b638562 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57a7 expref: 11 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783012.931294:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254600, rc 0) 00000100:00100000:0.0:1787783012.931378:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9a896bb7-a218-4158-9e10-c8ec78332a42+10:14431:x1874625904628864:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 914us (1134us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787783012.931387:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 25 00000100:00100000:3.0:1787783012.935026:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783012.935147:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904628992 00000100:00100000:2.0:1787783012.935160:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904628992 00000100:00100000:2.0:1787783012.935223:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:2.0:1787783012.935233:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a896bb7-a218-4158-9e10-c8ec78332a42+10:14431:x1874625904628992:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:2.0:1787783012.935265:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787783012.935294:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b63857e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e57ae expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.935407:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b638585 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.935425:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b638585 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.935437:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b638585 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787783012.935512:0:14332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787783012.935517:0:14332:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787783012.935550:0:14332:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b638585 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.935592:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b63857e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ae expref: 12 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.935615:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b638585 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ae expref: 11 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783012.935624:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c3108738300) 00010000:00010000:2.0:1787783012.935638:0:14332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787783012.935662:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204e00, rc 0) 00000100:00100000:2.0:1787783012.935741:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9a896bb7-a218-4158-9e10-c8ec78332a42+11:14431:x1874625904628992:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 509us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783012.935750:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:2.0:1787783012.940657:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783012.940822:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904629120 00000100:00100000:0.0:1787783012.940838:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904629120 00000100:00100000:0.0:1787783012.940918:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:0.0:1787783012.940930:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+11:14431:x1874625904629120:12345-192.168.202.15@tcp:37:lfs.0 00000100:00100000:2.0:1787783012.947173:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+11:14431:x1874625904629120:12345-192.168.202.15@tcp:37:lfs.0 Request processed in 6224us (6525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783012.947201:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:0.0:1787783012.951083:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783012.951375:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904629376 00000100:00100000:1.0:1787783012.951390:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904629376 00000100:00100000:1.0:1787783012.951501:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:1.0:1787783012.951514:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410d5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a896bb7-a218-4158-9e10-c8ec78332a42+11:14431:x1874625904629376:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787783012.952008:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410d5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9a896bb7-a218-4158-9e10-c8ec78332a42+12:14431:x1874625904629376:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 493us (936us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787783012.952018:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:0.0:1787783013.013085:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783013.015037:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904629504 00000100:00100000:1.0:1787783013.015057:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904629504 00000100:00100000:1.0:1787783013.015280:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:1.0:1787783013.015293:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+10:14437:x1874625904629504:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:1.0:1787783013.015324:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787783013.015353:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63858c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e57b5 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.015439:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638593 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.016222:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638593 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.016238:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638593 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.016260:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4800/0x6d98ed19b63859a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.016267:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4800/0x6d98ed19b63859a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.016274:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4800/0x6d98ed19b63859a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017434:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5800/0x6d98ed19b6385a1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017451:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5800/0x6d98ed19b6385a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017462:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5800/0x6d98ed19b6385a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787783013.017642:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787783013.017647:0:14330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787783013.017717:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5800/0x6d98ed19b6385a1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017745:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638593 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017778:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638593 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017785:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638593 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017791:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f4c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787783013.017796:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638593 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017804:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638593 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017821:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c31107b5500) 00010000:00010000:1.0:1787783013.017824:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787783013.017829:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638593 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017836:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638593 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017857:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4800/0x6d98ed19b63859a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017863:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4800/0x6d98ed19b63859a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017868:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4800/0x6d98ed19b63859a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017874:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f4800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787783013.017885:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4800/0x6d98ed19b63859a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017892:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4800/0x6d98ed19b63859a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017901:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c31107b5600) 00010000:00010000:1.0:1787783013.017903:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787783013.017907:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4800/0x6d98ed19b63859a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017913:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4800/0x6d98ed19b63859a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017965:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63858c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57b5 expref: 12 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017982:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5800/0x6d98ed19b6385a1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57b5 expref: 11 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.017990:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c3108738300) 00010000:00010000:1.0:1787783013.017993:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787783013.017996:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31029f5800, rc 0) 00000100:00100000:1.0:1787783013.018167:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+11:14437:x1874625904629504:12345-192.168.202.15@tcp:101:bash.0 Request processed in 2875us (5097us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783013.018177:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:0.0:1787783013.021540:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783013.028849:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904629760 00000100:00100000:2.0:1787783013.028873:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904629760 00000100:00100000:2.0:1787783013.028979:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 28 00000100:00100000:2.0:1787783013.028992:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+11:14437:x1874625904629760:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:2.0:1787783013.029020:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787783013.029048:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b6385a8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e57bc expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.029252:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6385af lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.029271:0:14332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b638585 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ae expref: 11 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.029281:0:14332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6385af lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.029330:0:14332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b638585 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ae expref: 11 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.029347:0:14332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b638585 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ae expref: 11 pid: 14332 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783013.029384:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14332:1874625922446208:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787783013.029533:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31052ea240 going to sleep for 11 seconds 00000100:00100000:0.0:1787783013.040331:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783013.040463:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904629888 00000100:00100000:1.0:1787783013.040492:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904629888 00010000:00010000:1.0:1787783013.040551:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b638585 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ae expref: 12 pid: 14332 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783013.040643:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:1.0:1787783013.040656:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+12:2349:x1874625904629888:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787783013.040680:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787783013.040688:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b638585 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ae expref: 12 pid: 14332 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.040703:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b638585 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ae expref: 12 pid: 14332 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.040734:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c3108738300) 00010000:00010000:1.0:1787783013.040740:0:14316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6385af lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.040752:0:14316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6385af lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.040762:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6385af lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.040787:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787783013.040862:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+12:2349:x1874625904629888:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 208us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783013.040871:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00010000:00010000:2.0:1787783013.041229:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b638585 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ae expref: 11 pid: 14332 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783013.041253:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16cb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14332:1874625922446208:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787783013.041281:0:14332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6385af lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.041303:0:14332:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6385af lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.041310:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6385af lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.041339:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6385b6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.041349:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6385b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.041357:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6385b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.044941:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b6385bd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.044971:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b6385bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.045003:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b6385bd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787783013.045020:0:14332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787783013.047966:0:14332:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6385af lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.047991:0:14332:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6385af lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.048000:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6385af lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.048007:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787783013.048013:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6385af lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.048022:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6385af lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.048044:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c3108738300) 00010000:00010000:2.0:1787783013.048047:0:14332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787783013.048054:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6385af lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.048061:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6385af lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787783013.048088:0:14332:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f02e667d reply state 00000000c642a202 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6385b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783013.048153:0:14332:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787783013.048230:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204200/0x6d98ed19b6385a8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57bc expref: 14 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.048248:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b6385bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57bc expref: 13 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.048256:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:2.0:1787783013.048258:0:14332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787783013.048261:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204c00, rc 0) 00000100:00100000:2.0:1787783013.048384:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+14:14437:x1874625904629760:12345-192.168.202.15@tcp:101:bash.0 Request processed in 19393us (27290us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787783013.048396:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 28 00010000:00010000:1.0:1787783013.051724:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6385b6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.051751:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6385b6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.051781:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6385b6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.051788:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787783013.051794:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6385b6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.051803:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6385b6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.051824:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8c3108738800) 00010000:00010000:1.0:1787783013.051828:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787783013.051834:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6385b6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.051841:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204600/0x6d98ed19b6385b6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787783013.062023:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783013.062427:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904630016 00000100:00100000:3.0:1787783013.062441:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904630016 00000100:00100000:3.0:1787783013.062643:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:3.0:1787783013.062656:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c94ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+13:14437:x1874625904630016:12345-192.168.202.15@tcp:101:bash.0 00010000:00010000:3.0:1787783013.062689:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787783013.062717:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b6385cb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e57c3 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783013.062810:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057000/0x6d98ed19b6385d2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783013.062827:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057000/0x6d98ed19b6385d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783013.062841:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057000/0x6d98ed19b6385d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787783013.062917:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787783013.062922:0:14331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787783013.062949:0:14331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057000/0x6d98ed19b6385d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783013.062961:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057000/0x6d98ed19b6385d2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783013.062991:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b6385cb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57c3 expref: 15 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783013.063013:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057000/0x6d98ed19b6385d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57c3 expref: 14 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783013.063022:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:3.0:1787783013.063026:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787783013.063029:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312a057000, rc 0) 00000100:00100000:3.0:1787783013.063318:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c94ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+14:14437:x1874625904630016:12345-192.168.202.15@tcp:101:bash.0 Request processed in 664us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783013.063328:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 29 00000100:00100000:0.0:1787783013.078990:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783013.082305:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904630272 00000100:00100000:2.0:1787783013.082330:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904630272 00000100:00100000:3.0:1787783013.082784:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:3.0:1787783013.082797:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:edb74ad9-50d8-46ec-9312-651fb814f467+14:14437:x1874625904630272:12345-192.168.202.15@tcp:35:bash.0 00000100:00100000:3.0:1787783013.083337:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:edb74ad9-50d8-46ec-9312-651fb814f467+15:14437:x1874625904630272:12345-192.168.202.15@tcp:35:bash.0 Request processed in 540us (4360us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787783013.083347:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00000040:00080000:1.0:1787783013.098339:0:14364:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787783013.220507:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783013.220612:0:16030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904630528 00000100:00100000:1.0:1787783013.220637:0:16030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904630528 00000100:00100000:1.0:1787783013.220728:0:16030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:1.0:1787783013.220741:0:16030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+15:14447:x1874625904630528:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787783013.220775:0:16030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787783013.220815:0:16030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b6385d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e57ca expref: -99 pid: 16030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787783013.220989:0:16030:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787783013.221218:0:16030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b6385d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ca expref: 17 pid: 16030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.221254:0:16030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c31107b5500) 00010000:00010000:1.0:1787783013.221258:0:16030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787783013.221264:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b6385d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ca expref: 17 pid: 16030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.221292:0:16030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31029f5600, rc 0) 00000100:00100000:1.0:1787783013.221361:0:16030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+16:14447:x1874625904630528:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 623us (884us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787783013.221369:0:16030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 30 00000100:00100000:0.0:1787783013.228570:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783013.228782:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904630784 00000100:00100000:1.0:1787783013.228807:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904630784 00000100:00100000:1.0:1787783013.228897:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:1.0:1787783013.228910:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:edb74ad9-50d8-46ec-9312-651fb814f467+16:14447:x1874625904630784:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787783013.229644:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:edb74ad9-50d8-46ec-9312-651fb814f467+17:14447:x1874625904630784:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 732us (1094us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787783013.229656:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:0.0:1787783013.284242:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783013.284377:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904631040 00000100:00100000:1.0:1787783013.284391:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904631040 00000100:00100000:1.0:1787783013.284477:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:1.0:1787783013.284501:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+17:14450:x1874625904631040:12345-192.168.202.15@tcp:101:lfs.0 00010000:00010000:1.0:1787783013.284538:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787783013.284580:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b6385e7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e57d1 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.284734:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4800/0x6d98ed19b6385ee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.284772:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4800/0x6d98ed19b6385ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.284786:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4800/0x6d98ed19b6385ee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787783013.284801:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787783013.284982:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b6385e7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57d1 expref: 20 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.285005:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4800/0x6d98ed19b6385ee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57d1 expref: 19 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.285015:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:1.0:1787783013.285018:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787783013.285021:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31029f4800, rc 0) 00000100:00100000:1.0:1787783013.285181:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+19:14450:x1874625904631040:12345-192.168.202.15@tcp:101:lfs.0 Request processed in 683us (956us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787783013.285190:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 31 00000100:00100000:2.0:1787783013.288793:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783013.288849:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783013.288852:0:16030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904631168 00000100:00100000:1.0:1787783013.288867:0:16030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904631168 00000100:00100000:1.0:1787783013.288961:0:16030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:1.0:1787783013.288973:0:16030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+19:14450:x1874625904631168:12345-192.168.202.15@tcp:54:lfs.0 00010000:00010000:1.0:1787783013.289069:0:16030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b6385fc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.289091:0:16030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b6385fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.289174:0:16030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b6385fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.289219:0:16030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b6385fc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.289226:0:16030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b6385fc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.289233:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b6385fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.289239:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f4c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787783013.289244:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b6385fc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.289253:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b6385fc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.289267:0:16030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:1.0:1787783013.289270:0:16030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787783013.289276:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b6385fc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.289281:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b6385fc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783013.289378:0:16030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+19:14450:x1874625904631168:12345-192.168.202.15@tcp:54:lfs.0 Request processed in 406us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783013.289388:0:16030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 32 00000100:00100000:3.0:1787783013.289477:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904631296 00000100:00100000:3.0:1787783013.289497:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904631296 00000100:00100000:3.0:1787783013.289543:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:3.0:1787783013.289551:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb74ad9-50d8-46ec-9312-651fb814f467+19:2349:x1874625904631296:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787783013.289575:0:14317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787783013.289595:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4800/0x6d98ed19b6385ee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57d1 expref: 19 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783013.289607:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:3.0:1787783013.289611:0:14317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787783013.289647:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb74ad9-50d8-46ec-9312-651fb814f467+18:2349:x1874625904631296:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 97us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783013.289654:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:0.0:1787783013.292303:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783013.292363:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904631552 00000100:00100000:1.0:1787783013.292406:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904631552 00000100:00100000:1.0:1787783013.292707:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:1.0:1787783013.292722:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:edb74ad9-50d8-46ec-9312-651fb814f467+18:14450:x1874625904631552:12345-192.168.202.15@tcp:35:lfs.0 00000100:00100000:1.0:1787783013.293071:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:edb74ad9-50d8-46ec-9312-651fb814f467+19:14450:x1874625904631552:12345-192.168.202.15@tcp:35:lfs.0 Request processed in 352us (785us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787783013.293080:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:0.0:1787783013.532570:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783013.532783:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904631808 00000100:00100000:1.0:1787783013.532797:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904631808 00000100:00100000:1.0:1787783013.532917:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:1.0:1787783013.532935:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+19:14481:x1874625904631808:12345-192.168.202.15@tcp:101:cat.0 00010000:00010000:1.0:1787783013.533136:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787783013.533165:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638603 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e57d8 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.533308:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63860a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.533327:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63860a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.533577:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63860a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787783013.533591:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787783013.533821:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638603 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57d8 expref: 22 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.533847:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63860a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57d8 expref: 21 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.533880:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:1.0:1787783013.533884:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787783013.533921:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31029f5600, rc 0) 00000100:00100000:1.0:1787783013.534361:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2ca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+21:14481:x1874625904631808:12345-192.168.202.15@tcp:101:cat.0 Request processed in 1427us (1807us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787783013.534371:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 33 00000100:00100000:2.0:1787783013.537471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783013.538943:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904631936 00000100:00100000:3.0:1787783013.539205:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904631936 00000100:00100000:2.0:1787783013.539756:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:2.0:1787783013.539773:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb74ad9-50d8-46ec-9312-651fb814f467+21:2350:x1874625904631936:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787783013.539798:0:14317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787783013.539836:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63860a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57d8 expref: 21 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.539861:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:2.0:1787783013.539890:0:14317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787783013.539981:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb74ad9-50d8-46ec-9312-651fb814f467+20:2350:x1874625904631936:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 213us (2529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783013.539991:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:1.0:1787783013.540256:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783013.540869:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904632192 00000100:00100000:3.0:1787783013.540879:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904632192 00000100:00100000:3.0:1787783013.540929:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:3.0:1787783013.540939:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:edb74ad9-50d8-46ec-9312-651fb814f467+20:14481:x1874625904632192:12345-192.168.202.15@tcp:35:cat.0 00000100:00100000:3.0:1787783013.541758:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:edb74ad9-50d8-46ec-9312-651fb814f467+21:14481:x1874625904632192:12345-192.168.202.15@tcp:35:cat.0 Request processed in 817us (1499us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787783013.541767:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 8 00000100:00100000:0.0:1787783013.600470:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783013.600605:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904632448 00000100:00100000:2.0:1787783013.600628:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904632448 00000100:00100000:2.0:1787783013.600711:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:2.0:1787783013.600724:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+21:14487:x1874625904632448:12345-192.168.202.15@tcp:101:dd.0 00010000:00010000:2.0:1787783013.600759:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787783013.600789:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b638618 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e57df expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.600929:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b63861f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.600961:0:14332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b6385bd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57bc expref: 22 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.600971:0:14332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057000/0x6d98ed19b6385d2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57c3 expref: 22 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.600980:0:14332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b63861f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.601025:0:14332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057000/0x6d98ed19b6385d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57c3 expref: 22 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.601042:0:14332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057000/0x6d98ed19b6385d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57c3 expref: 22 pid: 14331 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783013.601084:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14332:1874625922446336:192.168.202.15@tcp:104: 00010000:00010000:2.0:1787783013.601261:0:14332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b6385bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57bc expref: 22 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783013.601270:0:14332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b6385bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57bc expref: 22 pid: 14332 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783013.601279:0:14332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f16d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14332:1874625922446464:192.168.202.15@tcp:104: 00000100:00100000:2.0:1787783013.601306:0:14332:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31052ea240 going to sleep for 11 seconds 00000100:00100000:1.0:1787783013.606054:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14332:1874625922446336:192.168.202.15@tcp:104: 00000100:00100000:1.0:1787783013.606075:0:14332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f16d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14332:1874625922446464:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787783013.606145:0:14332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b63861f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787783013.608424:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783013.608594:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783013.608826:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904632576 00000100:00100000:1.0:1787783013.608838:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904632576 00010000:00010000:1.0:1787783013.608895:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057000/0x6d98ed19b6385d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57c3 expref: 23 pid: 14331 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783013.608941:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904632704 00000100:00100000:1.0:1787783013.608945:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904632704 00010000:00010000:1.0:1787783013.608960:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b6385bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57bc expref: 24 pid: 14332 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783013.608978:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:1.0:1787783013.608989:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313e58f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edb74ad9-50d8-46ec-9312-651fb814f467+24:2349:x1874625904632576:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787783013.609010:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787783013.609037:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057000/0x6d98ed19b6385d2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57c3 expref: 24 pid: 14331 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.609052:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057000/0x6d98ed19b6385d2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57c3 expref: 24 pid: 14331 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.609080:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057000/0x6d98ed19b6385d2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57c3 expref: 24 pid: 14331 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.609136:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:1.0:1787783013.609143:0:14316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b63861f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.609153:0:14316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b63861f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.609160:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787783013.609239:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313e58f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edb74ad9-50d8-46ec-9312-651fb814f467+23:2349:x1874625904632576:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 251us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783013.609248:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:1.0:1787783013.609322:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:1.0:1787783013.609331:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edb74ad9-50d8-46ec-9312-651fb814f467+22:2349:x1874625904632704:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787783013.609339:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787783013.609345:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b6385bd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57bc expref: 22 pid: 14332 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.609355:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b6385bd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57bc expref: 22 pid: 14332 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.609598:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b6385bd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e57bc expref: 22 pid: 14332 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.609613:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:1.0:1787783013.609617:0:14316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b63861f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.609635:0:14316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b63861f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.609644:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b63861f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.609722:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787783013.609755:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edb74ad9-50d8-46ec-9312-651fb814f467+21:2349:x1874625904632704:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 425us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783013.609763:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00010000:00010000:0.0:1787783013.610465:0:14332:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b63861f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783013.610478:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b63861f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787783013.610506:0:14332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787783013.610845:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b638618 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57df expref: 22 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783013.610867:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204e00/0x6d98ed19b63861f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57df expref: 21 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783013.610876:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:0.0:1787783013.610879:0:14332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787783013.610882:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141204e00, rc 0) 00000100:00100000:0.0:1787783013.610982:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2cbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+21:14487:x1874625904632448:12345-192.168.202.15@tcp:101:dd.0 Request processed in 10260us (10529us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787783013.610991:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 34 00000100:00100000:0.0:1787783013.614640:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783013.614763:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904632960 00000100:00100000:3.0:1787783013.614777:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904632960 00000100:00100000:3.0:1787783013.614891:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 35 00000100:00100000:3.0:1787783013.614904:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+21:14487:x1874625904632960:12345-192.168.202.15@tcp:36:dd.0 00010000:00010000:3.0:1787783013.615768:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b63862d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783013.615808:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b63862d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783013.615822:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b63862d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787783013.615900:0:14331:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1787783013.616090:0:14331:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007096dc5b reply state 000000000e50660d transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b63862d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783013.616182:0:14331:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787783013.616395:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+24:14487:x1874625904632960:12345-192.168.202.15@tcp:36:dd.0 Request processed in 1491us (1837us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1787783013.616404:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 35 00000020:00080000:3.0:1787783013.616411:0:14331:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787783013.620905:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783013.621025:0:16030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904633088 00000100:00100000:1.0:1787783013.621039:0:16030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904633088 00000100:00100000:1.0:1787783013.621178:0:16030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 36 00000100:00100000:1.0:1787783013.621192:0:16030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+24:14487:x1874625904633088:12345-192.168.202.15@tcp:101:dd.0 00010000:00010000:1.0:1787783013.621231:0:16030:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787783013.621261:0:16030:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5000/0x6d98ed19b638634 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e57e6 expref: -99 pid: 16030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.621345:0:16030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5000/0x6d98ed19b638634 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57e6 expref: 25 pid: 16030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.621385:0:16030:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5000/0x6d98ed19b638634 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57e6 expref: 25 pid: 16030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.621412:0:16030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:1.0:1787783013.621416:0:16030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787783013.621420:0:16030:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31029f5000, rc 0) 00000100:00100000:1.0:1787783013.621518:0:16030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2cad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+25:14487:x1874625904633088:12345-192.168.202.15@tcp:101:dd.0 Request processed in 328us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783013.621527:0:16030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 36 00010000:00010000:3.0:1787783013.621706:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b63862d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783013.621715:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b63862d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783013.621723:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b63862d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783013.621731:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a057800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787783013.621737:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b63862d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783013.621746:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b63862d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783013.621775:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:3.0:1787783013.621777:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787783013.621782:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b63862d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783013.621788:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b63862d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783013.631007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783013.631132:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904633344 00000100:00100000:1.0:1787783013.631145:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904633344 00000100:00100000:1.0:1787783013.631232:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:1.0:1787783013.631243:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edb74ad9-50d8-46ec-9312-651fb814f467+24:14487:x1874625904633344:12345-192.168.202.15@tcp:103:dd.0 00010000:00010000:1.0:1787783013.631266:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787783013.631301:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5000/0x6d98ed19b638634 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57e6 expref: 24 pid: 16030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.631326:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:1.0:1787783013.631332:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787783013.631467:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edb74ad9-50d8-46ec-9312-651fb814f467+23:14487:x1874625904633344:12345-192.168.202.15@tcp:103:dd.0 Request processed in 225us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783013.631477:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:2.0:1787783013.633753:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783013.633863:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904633472 00000100:00100000:1.0:1787783013.633875:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904633472 00000100:00100000:1.0:1787783013.634038:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:1.0:1787783013.634052:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+23:14487:x1874625904633472:12345-192.168.202.15@tcp:58:dd.0 00010000:00010000:1.0:1787783013.634247:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5e00/0x6d98ed19b63863b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.634272:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5e00/0x6d98ed19b63863b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.634287:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5e00/0x6d98ed19b63863b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787783013.635435:0:14330:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787783013.636049:0:14330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1787783013.636165:0:14330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1787783013.636390:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+23:14487:x1874625904633472:12345-192.168.202.15@tcp:58:dd.0 Request processed in 2334us (2644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783013.636404:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 37 00000100:00100000:0.0:1787783013.640207:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783013.640466:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904633600 00000100:00100000:1.0:1787783013.640477:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904633600 00000100:00100000:1.0:1787783013.640568:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 38 00000100:00100000:1.0:1787783013.640580:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+23:14487:x1874625904633600:12345-192.168.202.15@tcp:101:dd.0 00010000:00010000:1.0:1787783013.640611:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787783013.640753:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638642 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e57ed expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.640828:0:14332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5e00/0x6d98ed19b63863b lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.640838:0:14332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638642 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ed expref: 24 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.640857:0:14332:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5e00/0x6d98ed19b63863b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.640890:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638642 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ed expref: 24 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.640903:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:1.0:1787783013.640906:0:14332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787783013.640908:0:14332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638642 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ed expref: 24 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783013.640914:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c31029f4c00, rc 0) 00000100:00100000:1.0:1787783013.641068:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2ca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+24:14487:x1874625904633600:12345-192.168.202.15@tcp:101:dd.0 Request processed in 488us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783013.641075:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 38 00010000:00010000:1.0:1787783013.794378:0:16032:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787783014.113500:0:14364:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787783014.113512:0:14364:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787783014.113557:0:14364:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787783014.113565:0:14364:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787783014.113745:0:14364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd2d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14364:1874625922446592:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787783014.113960:0:14364:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31061e0000 going to sleep for 11 seconds 00000100:00100000:1.0:1787783014.119934:0:14364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd2d00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14364:1874625922446592:192.168.202.15@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787783014.121206:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783014.121417:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904633728 00000100:00100000:1.0:1787783014.121427:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904633728 00000100:00100000:1.0:1787783014.121507:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:1.0:1787783014.121518:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:edb74ad9-50d8-46ec-9312-651fb814f467+24:14488:x1874625904633728:12345-192.168.202.15@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787783014.121632:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:edb74ad9-50d8-46ec-9312-651fb814f467+24:14488:x1874625904633728:12345-192.168.202.15@tcp:900:lhsmtool_posix.0 Request processed in 115us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783014.121659:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00080000:2.0:1787783014.121912:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787783014.123027:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783014.123120:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904633856 00000100:00100000:3.0:1787783014.123128:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904633856 00000100:00100000:3.0:1787783014.123181:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:3.0:1787783014.123190:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+24:14488:x1874625904633856:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787783014.123238:0:14331:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787783014.123373:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2cb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+24:14488:x1874625904633856:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 183us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783014.123381:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 39 00000100:00100000:3.0:1787783014.127993:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783014.128282:0:16030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904633984 00000100:00100000:2.0:1787783014.128299:0:16030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904633984 00000100:00100000:2.0:1787783014.128388:0:16030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:2.0:1787783014.128400:0:16030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313cc883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+24:14488:x1874625904633984:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787783014.128500:0:16030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b638649 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.128522:0:16030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b638649 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.128536:0:16030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b638649 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.128794:0:16030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b638650 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.128823:0:16030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b638650 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.128837:0:16030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b638650 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.128873:0:16030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b638657 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.128882:0:16030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b638657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.128889:0:16030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b638657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787783014.128939:0:16030:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787783014.128945:0:16030:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787783014.128964:0:16030:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b638657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.128976:0:16030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b638649 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.128984:0:16030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b638649 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129002:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b638649 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129026:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787783014.129031:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b638649 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129038:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b638649 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129052:0:16030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c31107b5300) 00010000:00010000:2.0:1787783014.129055:0:16030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787783014.129059:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b638649 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129066:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204c00/0x6d98ed19b638649 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129086:0:16030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b638650 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129169:0:16030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b638650 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129177:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b638650 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129182:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787783014.129186:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b638650 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129193:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b638650 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129213:0:16030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8c3108738700) 00010000:00010000:2.0:1787783014.129216:0:16030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787783014.129219:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b638650 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129226:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b638650 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129243:0:16030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b638657 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129249:0:16030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b638657 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129256:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b638657 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129261:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:2.0:1787783014.129265:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b638657 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129271:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b638657 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129279:0:16030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:2.0:1787783014.129281:0:16030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787783014.129284:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b638657 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.129290:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141205800/0x6d98ed19b638657 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783014.129406:0:16030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313cc883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+24:14488:x1874625904633984:12345-192.168.202.15@tcp:34:lhsmtool_posix.0 Request processed in 1002us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783014.129419:0:16030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 40 00000100:00100000:2.0:1787783014.132254:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783014.132375:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904634240 00000100:00100000:3.0:1787783014.132392:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904634240 00000100:00100000:3.0:1787783014.132486:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:3.0:1787783014.132499:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+24:14488:x1874625904634240:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787783014.132525:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787783014.132560:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b63865e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e57f4 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.132707:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057400/0x6d98ed19b638665 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.132747:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057400/0x6d98ed19b638665 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.132761:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057400/0x6d98ed19b638665 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787783014.132776:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787783014.132911:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057400/0x6d98ed19b638665 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.132920:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057400/0x6d98ed19b638665 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.132927:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057400/0x6d98ed19b638665 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.132934:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a057400 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787783014.132939:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057400/0x6d98ed19b638665 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.132947:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057400/0x6d98ed19b638665 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.132962:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:3.0:1787783014.132965:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787783014.132971:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057400/0x6d98ed19b638665 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.132978:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057400/0x6d98ed19b638665 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.133036:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b63865e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57f4 expref: 26 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.133055:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c31107b5300) 00010000:00010000:3.0:1787783014.133057:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787783014.133062:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b63865e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57f4 expref: 26 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.133072:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312a057800, rc 0) 00000100:00100000:3.0:1787783014.133233:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+25:14488:x1874625904634240:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 736us (988us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1787783014.133242:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 41 00000100:00100000:0.0:1787783014.137025:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783014.137160:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904634368 00000100:00100000:1.0:1787783014.137173:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904634368 00000100:00100000:1.0:1787783014.137250:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:1.0:1787783014.137263:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+25:14488:x1874625904634368:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787783014.137314:0:14332:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787783014.137498:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2ca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+25:14488:x1874625904634368:12345-192.168.202.15@tcp:53:lhsmtool_posix.0 Request processed in 225us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783014.137508:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 42 00000100:00100000:2.0:1787783014.148524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783014.155123:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904634624 00000100:00100000:3.0:1787783014.155142:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904634624 00000100:00100000:3.0:1787783014.155225:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:3.0:1787783014.155236:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+25:14488:x1874625904634624:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787783014.155258:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787783014.155282:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b638673 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e57fb expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787783014.156052:0:14331:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:3.0:1787783014.156060:0:14331:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1787783014.156151:0:14331:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1787783014.156442:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057400/0x6d98ed19b63867a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.156459:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057400/0x6d98ed19b63867a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.156471:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057400/0x6d98ed19b63867a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.156542:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b638673 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57fb expref: 28 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.156562:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057400/0x6d98ed19b63867a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57fb expref: 27 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.156571:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c312161ce00) 00010000:00010000:3.0:1787783014.156573:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787783014.156577:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312a057400, rc 0) 00000100:00100000:3.0:1787783014.156667:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+27:14488:x1874625904634624:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 1432us (8152us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1787783014.156676:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 43 00000100:00100000:2.0:1787783014.161598:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783014.161842:0:16030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904634880 00000100:00100000:1.0:1787783014.161852:0:16030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904634880 00000100:00100000:1.0:1787783014.161915:0:16030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:1.0:1787783014.161926:0:16030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+27:14488:x1874625904634880:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787783014.161986:0:16030:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787783014.162188:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057400/0x6d98ed19b63867a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57fb expref: 27 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162209:0:16030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c312161ce00) 00010000:00010000:1.0:1787783014.162221:0:16030:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787783014.162244:0:16030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5000/0x6d98ed19b638688 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162258:0:16030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5000/0x6d98ed19b638688 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162269:0:16030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5000/0x6d98ed19b638688 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162299:0:16030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63868f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3e054b3c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162307:0:16030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63868f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e054b3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162315:0:16030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63868f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e054b3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162389:0:16030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5000/0x6d98ed19b638688 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162397:0:16030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5000/0x6d98ed19b638688 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162403:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5000/0x6d98ed19b638688 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162409:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f5000 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787783014.162413:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5000/0x6d98ed19b638688 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162421:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5000/0x6d98ed19b638688 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162430:0:16030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c3108738300) 00010000:00010000:1.0:1787783014.162433:0:16030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787783014.162437:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5000/0x6d98ed19b638688 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162444:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5000/0x6d98ed19b638688 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162461:0:16030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63868f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e054b3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162468:0:16030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63868f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e054b3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162474:0:16030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63868f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e054b3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162479:0:16030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f5600 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787783014.162483:0:16030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63868f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e054b3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162489:0:16030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63868f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e054b3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162498:0:16030:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x3e054b3c (ffff8c31107b5600) 00010000:00010000:1.0:1787783014.162500:0:16030:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787783014.162503:0:16030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63868f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3e054b3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.162508:0:16030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5600/0x6d98ed19b63868f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3e054b3c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16030 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783014.162648:0:16030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+26:14488:x1874625904634880:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 722us (1058us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787783014.162656:0:16030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 44 00000100:00100000:1.0:1787783014.177064:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783014.177396:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904635008 00000100:00100000:0.0:1787783014.177406:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904635008 00000100:00100000:0.0:1787783014.177468:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:0.0:1787783014.177480:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+26:14488:x1874625904635008:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787783014.177501:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787783014.177525:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b638696 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5802 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783014.177562:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254c00/0x6d98ed19b63869d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783014.177578:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254c00/0x6d98ed19b63869d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783014.177589:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254c00/0x6d98ed19b63869d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783014.177894:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141255c00/0x6d98ed19b638696 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5802 expref: 28 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783014.177912:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141254c00/0x6d98ed19b63869d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5802 expref: 27 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783014.177921:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c310823c200) 00010000:00010000:0.0:1787783014.177924:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787783014.177927:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141254c00, rc 0) 00000100:00100000:0.0:1787783014.178090:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+27:14488:x1874625904635008:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 513us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783014.178148:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 45 00000100:00100000:2.0:1787783014.180324:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783014.180441:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904635264 00000100:00100000:3.0:1787783014.180450:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904635264 00000100:00100000:3.0:1787783014.180504:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:3.0:1787783014.180515:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+27:14488:x1874625904635264:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787783014.180804:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b6386a4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.180820:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b6386a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.180832:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b6386a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787783014.181390:0:14332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1787783014.181400:0:14332:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 498851303819ns, next at 499851301569ns, rc = 0 00000004:00010000:3.0:1787783014.181490:0:14332:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045e8c206 reply state 000000009940de8c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b6386a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783014.181499:0:14332:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787783014.181574:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+29:14488:x1874625904635264:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 1060us (1258us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787783014.181582:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 46 00000100:00100000:2.0:1787783014.186419:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783014.186712:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904635392 00000100:00100000:3.0:1787783014.186725:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904635392 00000100:00100000:3.0:1787783014.186801:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 47 00000100:00100000:3.0:1787783014.186812:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+29:14488:x1874625904635392:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787783014.186845:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787783014.186873:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056000/0x6d98ed19b6386ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5809 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.186958:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056000/0x6d98ed19b6386ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5809 expref: 30 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.186975:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056000/0x6d98ed19b6386ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5809 expref: 30 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.186998:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c310823c200) 00010000:00010000:3.0:1787783014.187003:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787783014.187008:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312a056000, rc 0) 00000100:00100000:3.0:1787783014.187081:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+30:14488:x1874625904635392:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 271us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783014.187090:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 47 00010000:00010000:1.0:1787783014.187179:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b6386a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.187219:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b6386a4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.187227:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b6386a4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.187234:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a057800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787783014.187240:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b6386a4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.187249:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b6386a4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.187267:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c310823c200) 00010000:00010000:1.0:1787783014.187270:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787783014.187275:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b6386a4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.187281:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057800/0x6d98ed19b6386a4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783014.193639:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783014.193939:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904635520 00000100:00100000:2.0:1787783014.193956:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904635520 00000100:00100000:2.0:1787783014.194072:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:2.0:1787783014.194086:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:edb74ad9-50d8-46ec-9312-651fb814f467+5:2349:x1874625904635520:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787783014.194665:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787783014.195057:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:edb74ad9-50d8-46ec-9312-651fb814f467+6:2349:x1874625904635520:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 960us (1424us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787783014.195070:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 12 00000100:00100000:2.0:1787783014.207664:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783014.207921:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904635776 00000100:00100000:1.0:1787783014.207936:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904635776 00000100:00100000:1.0:1787783014.208014:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:1.0:1787783014.208026:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f16cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:edb74ad9-50d8-46ec-9312-651fb814f467+29:14488:x1874625904635776:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787783014.208397:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f16cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:edb74ad9-50d8-46ec-9312-651fb814f467+30:14488:x1874625904635776:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 373us (748us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787783014.208406:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 9 00000100:00100000:2.0:1787783014.213742:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783014.213938:0:16030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904636032 00000100:00100000:1.0:1787783014.213955:0:16030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904636032 00000100:00100000:1.0:1787783014.214040:0:16030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:1.0:1787783014.214052:0:16030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+30:14488:x1874625904636032:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787783014.214245:0:16030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+30:14488:x1874625904636032:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 195us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783014.214254:0:16030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 48 00000100:00100000:2.0:1787783014.216923:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783014.218160:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904636160 00000100:00100000:3.0:1787783014.218177:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904636160 00000100:00100000:3.0:1787783014.218267:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:3.0:1787783014.218279:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+30:14488:x1874625904636160:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787783014.218308:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787783014.218338:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056c00/0x6d98ed19b6386b2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5810 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.218434:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386b9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.218452:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.218467:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787783014.218531:0:14331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787783014.218567:0:14331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.218600:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056c00/0x6d98ed19b6386b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5810 expref: 32 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.218635:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5810 expref: 31 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.218646:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c310823c200) 00010000:00010000:3.0:1787783014.218650:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787783014.218654:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c312a056800, rc 0) 00000100:00100000:3.0:1787783014.220800:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+31:14488:x1874625904636160:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 2506us (3874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783014.220815:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 49 00000100:00100000:2.0:1787783014.232398:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783014.236368:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904636288 00000100:00100000:0.0:1787783014.236393:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904636288 00000100:00100000:0.0:1787783014.236701:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:0.0:1787783014.236716:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313c97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edb74ad9-50d8-46ec-9312-651fb814f467+6:2350:x1874625904636288:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787783014.236743:0:15013:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787783014.236773:0:15013:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000335bbc51/0x6d98ed19b6386c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7f762009527e5817 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787783014.236810:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f6766, blocks: 0x1 00010000:00010000:0.0:1787783014.236839:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=498s v=(0 0) 00010000:00010000:0.0:1787783014.236844:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787783014.236857:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000335bbc51/0x6d98ed19b6386c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5817 expref: 7 pid: 15013 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783014.236882:0:15013:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000335bbc51/0x6d98ed19b6386c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5817 expref: 7 pid: 15013 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783014.236900:0:15013:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c3141255c00, rc 0) 00000100:00100000:0.0:1787783014.236997:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313c97f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edb74ad9-50d8-46ec-9312-651fb814f467+7:2350:x1874625904636288:12345-192.168.202.15@tcp:101:lhsmtool_posix.0 Request processed in 284us (4614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783014.237006:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:2.0:1787783014.242310:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783014.246752:0:16030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904636544 00000100:00100000:1.0:1787783014.246772:0:16030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904636544 00000100:00100000:1.0:1787783014.246861:0:16030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:1.0:1787783014.246872:0:16030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+31:14488:x1874625904636544:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787783014.248656:0:16030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+31:14488:x1874625904636544:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 1771us (6349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783014.248673:0:16030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 50 00000100:00100000:2.0:1787783014.255770:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783014.260597:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904636672 00000100:00100000:0.0:1787783014.260629:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904636672 00000100:00100000:0.0:1787783014.260729:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 51 00000100:00100000:0.0:1787783014.260741:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+31:14488:x1874625904636672:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787783014.341218:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:edb74ad9-50d8-46ec-9312-651fb814f467+31:14488:x1874625904636672:12345-192.168.202.15@tcp:44:lhsmtool_posix.0 Request processed in 80461us (85446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783014.341233:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 51 00000001:00080000:3.0:1787783014.343949:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:3.0:1787783014.343973:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1787783014.343986:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1787783014.344032:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:3.0:1787783014.344056:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787783014.347089:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787783014.347252:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312f2c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922446720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787783014.348231:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783014.348469:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:1.0:1787783014.348648:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922446720 00000100:00100000:1.0:1787783014.348658:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922446720 00000100:00100000:1.0:1787783014.348734:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904636800 00000100:00100000:1.0:1787783014.348738:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904636800 00000100:00100000:1.0:1787783014.348762:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787783014.348772:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874625922446720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787783014.349013:0:15012:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787783014.349017:0:15012:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787783014.349020:0:15012:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787783014.349022:0:15012:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787783014 -> 1787783014 00002000:00010000:1.0:1787783014.349024:0:15012:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787783014.349090:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874625922446720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 319us (862us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787783014.349146:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787783014.349168:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:1.0:1787783014.349175:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:edb74ad9-50d8-46ec-9312-651fb814f467+7:2349:x1874625904636800:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1787783014.351310:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c312f2c9a40/2, rc 0, transno 8589934595 00000100:00100000:0.0:1787783014.351333:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312f2c9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874625922446720:0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1787783014.351691:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787783014.352028:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:edb74ad9-50d8-46ec-9312-651fb814f467+7:2349:x1874625904636800:12345-192.168.202.15@tcp:16:lhsmtool_posix.0 Request processed in 2845us (3553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783014.352044:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:2.0:1787783014.364035:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783014.365490:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904637056 00000100:00100000:3.0:1787783014.365514:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904637056 00000100:00100000:3.0:1787783014.365751:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:3.0:1787783014.365763:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+14:14488:x1874625904637056:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787783014.365839:0:14332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787783014.365881:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5810 expref: 14 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.365908:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c310823c200) 00010000:00010000:3.0:1787783014.365914:0:14332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787783014.365956:0:14332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056c00/0x6d98ed19b6386c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.365974:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056c00/0x6d98ed19b6386c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.365985:0:14332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056c00/0x6d98ed19b6386c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787783014.366450:0:14332:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090e250c1 reply state 00000000697bd76c transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056c00/0x6d98ed19b6386c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783014.366494:0:14332:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787783014.366759:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:edb74ad9-50d8-46ec-9312-651fb814f467+15:14488:x1874625904637056:12345-192.168.202.15@tcp:36:lhsmtool_posix.0 Request processed in 996us (2737us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787783014.366768:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 52 00000100:00100000:3.0:1787783014.369936:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00010000:00010000:1.0:1787783014.370178:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056c00/0x6d98ed19b6386c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.370193:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056c00/0x6d98ed19b6386c7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.370203:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056c00/0x6d98ed19b6386c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.370212:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a056c00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787783014.370218:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056c00/0x6d98ed19b6386c7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.370228:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056c00/0x6d98ed19b6386c7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.370251:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c310823c200) 00010000:00010000:1.0:1787783014.370255:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787783014.370260:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056c00/0x6d98ed19b6386c7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.370268:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056c00/0x6d98ed19b6386c7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14332 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787783014.370401:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904637184 00000100:00100000:0.0:1787783014.370416:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904637184 00000100:00100000:0.0:1787783014.370510:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:0.0:1787783014.370522:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c313ccabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edb74ad9-50d8-46ec-9312-651fb814f467+7:2349:x1874625904637184:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787783014.370817:0:15013:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787783014.370821:0:15013:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787783013 00002000:00010000:0.0:1787783014.370824:0:15013:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787783013 00002000:00010000:0.0:1787783014.370827:0:15013:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787783014 -> 1787783013 00002000:00010000:0.0:1787783014.370829:0:15013:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787783014.370926:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c313ccabc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edb74ad9-50d8-46ec-9312-651fb814f467+8:2349:x1874625904637184:12345-192.168.202.15@tcp:2:lhsmtool_posix.0 Request processed in 405us (1006us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787783014.370935:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:0.0:1787783014.374224:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783014.378796:0:15495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904637312 00000100:00100000:3.0:1787783014.378817:0:15495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904637312 00000100:00100000:3.0:1787783014.378913:0:15495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:3.0:1787783014.378927:0:15495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312f2c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:edb74ad9-50d8-46ec-9312-651fb814f467+8:2349:x1874625904637312:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787783014.378988:0:15495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386ce lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.379011:0:15495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787783014.379017:0:15495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787783014.379025:0:15495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.379047:0:15495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.379088:0:15495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.379117:0:15495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.379153:0:15495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.379162:0:15495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a057a00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787783014.379168:0:15495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.379180:0:15495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.379200:0:15495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.379209:0:15495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783014.379323:0:15495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312f2c9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:edb74ad9-50d8-46ec-9312-651fb814f467+8:2349:x1874625904637312:12345-192.168.202.15@tcp:1:lhsmtool_posix.0 Request processed in 397us (5114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783014.379331:0:15495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:1.0:1787783014.384527:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783014.384733:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904637568 00000100:00100000:3.0:1787783014.384746:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904637568 00000100:00100000:3.0:1787783014.384830:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 53 00000100:00100000:3.0:1787783014.384842:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+14:14488:x1874625904637568:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787783014.384959:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057e00/0x6d98ed19b6386d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.385001:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057e00/0x6d98ed19b6386d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.385016:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057e00/0x6d98ed19b6386d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.385393:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386dc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.385407:0:14331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056000/0x6d98ed19b6386ab lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5809 expref: 15 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.385417:0:14331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386dc lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.385728:0:14331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056000/0x6d98ed19b6386ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5809 expref: 15 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.385748:0:14331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056000/0x6d98ed19b6386ab lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5809 expref: 15 pid: 14331 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783014.385767:0:14331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cca9680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14331:1874625922446848:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787783014.385899:0:14331:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3105112240 going to sleep for 11 seconds 00000100:00100000:3.0:1787783014.390139:0:14331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cca9680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14331:1874625922446848:192.168.202.15@tcp:104: 00010000:00010000:3.0:1787783014.390182:0:14331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386dc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783014.399281:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783014.399427:0:14317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904637696 00000100:00100000:2.0:1787783014.399442:0:14317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904637696 00010000:00010000:2.0:1787783014.399526:0:14317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056000/0x6d98ed19b6386ab lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5809 expref: 16 pid: 14331 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783014.399606:0:14317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 13 00000100:00100000:2.0:1787783014.399629:0:14317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb74ad9-50d8-46ec-9312-651fb814f467+16:2349:x1874625904637696:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787783014.399654:0:14317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787783014.399664:0:14317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056000/0x6d98ed19b6386ab lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5809 expref: 16 pid: 14331 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.399679:0:14317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056000/0x6d98ed19b6386ab lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5809 expref: 16 pid: 14331 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.399711:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056000/0x6d98ed19b6386ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5809 expref: 16 pid: 14331 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.399732:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c310823c200) 00010000:00010000:2.0:1787783014.399739:0:14317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386dc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.399751:0:14317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.399762:0:14317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386dc lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.399804:0:14317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787783014.399881:0:14317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edb74ad9-50d8-46ec-9312-651fb814f467+15:2349:x1874625904637696:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 255us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787783014.399891:0:14317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 13 00010000:00010000:3.0:1787783014.399983:0:14331:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.400001:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787783014.400322:0:14331:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1787783014.400508:0:14331:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1787783014.400559:0:14331:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1787783014.400679:0:14331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313cca9680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14331:1874625922446976:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787783014.401053:0:14331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787783014.401192:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922446976 00000100:00100000:0.0:1787783014.401201:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922446976 00000100:00100000:0.0:1787783014.401252:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787783014.401262:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14331:x1874625922446976:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787783014.408492:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14331:x1874625922446976:12345-0@lo:1000:mdt00_001.0 Request processed in 7214us (7429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787783014.408512:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787783014.408931:0:14331:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31061e0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787783014.409011:0:14331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313cca9680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14331:1874625922446976:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787783014.410024:0:14331:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787783014.410173:0:14331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c312ee73840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14331:1874625922447104:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787783014.410274:0:14331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787783014.410313:0:14331:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c3108f07a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787783014.410473:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922447104 00000100:00100000:1.0:1787783014.410482:0:14336:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922447104 00000100:00100000:1.0:1787783014.410547:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787783014.410558:0:14336:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14331:x1874625922447104:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787783014.410800:0:14336:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14331:x1874625922447104:12345-0@lo:1000:mdt00_001.0 Request processed in 243us (526us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787783014.410808:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787783014.410864:0:14331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c312ee73840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14331:1874625922447104:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787783014.410918:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386dc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.410931:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386dc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.410940:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386dc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.410947:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a056800 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787783014.410953:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386dc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.410962:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386dc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.410984:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c310823c200) 00010000:00010000:1.0:1787783014.410988:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787783014.411004:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386dc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.411012:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a056800/0x6d98ed19b6386dc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.411055:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5e00/0x6d98ed19b63863b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.411061:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5e00/0x6d98ed19b63863b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.411068:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5e00/0x6d98ed19b63863b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.411074:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f5e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:1.0:1787783014.411077:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5e00/0x6d98ed19b63863b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.411083:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5e00/0x6d98ed19b63863b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.411092:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:1.0:1787783014.411122:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787783014.411130:0:14331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638642 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ed expref: 18 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.411144:0:14331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638642 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ed expref: 18 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.411156:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638642 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ed expref: 18 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.411228:0:14331:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f4c00/0x6d98ed19b638642 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e57ed expref: 18 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783014.411243:0:14331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14331:1874625922447232:192.168.202.15@tcp:105: 00000100:00100000:1.0:1787783014.411474:0:14331:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c31063a4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787783014.422717:0:14331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14331:1874625922447232:192.168.202.15@tcp:105: 00010000:00010000:3.0:1787783014.422769:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5e00/0x6d98ed19b63863b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.422783:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c31029f5e00/0x6d98ed19b63863b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.422835:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057a00/0x6d98ed19b6386e3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.422863:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057a00/0x6d98ed19b6386e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.422878:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057a00/0x6d98ed19b6386e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.422893:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057a00/0x6d98ed19b6386e3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.422901:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057a00/0x6d98ed19b6386e3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.422909:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057a00/0x6d98ed19b6386e3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.422940:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a057a00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787783014.422946:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057a00/0x6d98ed19b6386e3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.422956:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057a00/0x6d98ed19b6386e3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.422976:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:3.0:1787783014.422980:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787783014.422984:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057a00/0x6d98ed19b6386e3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.422991:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057a00/0x6d98ed19b6386e3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.423002:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057e00/0x6d98ed19b6386d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.423007:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057e00/0x6d98ed19b6386d5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.423013:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057e00/0x6d98ed19b6386d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.423018:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a057e00 already unused, calling callback (ffffffffc1e3a4f0) 00010000:00010000:3.0:1787783014.423021:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057e00/0x6d98ed19b6386d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.423027:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057e00/0x6d98ed19b6386d5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.423048:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c3108738500) 00010000:00010000:3.0:1787783014.423050:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787783014.423052:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057e00/0x6d98ed19b6386d5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.423058:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c312a057e00/0x6d98ed19b6386d5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783014.425015:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:edb74ad9-50d8-46ec-9312-651fb814f467+18:14488:x1874625904637568:12345-192.168.202.15@tcp:57:lhsmtool_posix.0 Request processed in 40163us (40493us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1787783014.425029:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 53 00000020:00080000:3.0:1787783014.425048:0:14331:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787783014.426987:0:14364:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787783014.427003:0:14364:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787783014.427048:0:14364:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787783014.427057:0:14364:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787783014.427372:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783014.427689:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904637824 00000100:00100000:3.0:1787783014.427701:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904637824 00000100:00100000:3.0:1787783014.427764:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:3.0:1787783014.427775:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31410d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:edb74ad9-50d8-46ec-9312-651fb814f467+18:14487:x1874625904637824:12345-192.168.202.15@tcp:49:dd.0 00000100:00100000:3.0:1787783014.427938:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31410d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:edb74ad9-50d8-46ec-9312-651fb814f467+18:14487:x1874625904637824:12345-192.168.202.15@tcp:49:dd.0 Request processed in 164us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783014.427946:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 10 00000100:00100000:1.0:1787783014.443922:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783014.444041:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904638080 00000100:00100000:3.0:1787783014.444051:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904638080 00000100:00100000:2.0:1787783014.444297:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 11 00000100:00100000:2.0:1787783014.444310:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:edb74ad9-50d8-46ec-9312-651fb814f467+18:14488:x1874625904638080:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787783014.445087:0:14333:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787783014.445235:0:14333:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787783014.445281:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6386ea lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.445298:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6386ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.445309:0:14333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6386ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.445318:0:14333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6386ea lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.445324:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6386ea lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.445330:0:14333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6386ea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.445352:0:14333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787783014.445401:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787783014.445410:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6386ea lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.445419:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204800 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787783014.445424:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6386ea lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.445447:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6386ea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783014.445450:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:edb74ad9-50d8-46ec-9312-651fb814f467+20:14488:x1874625904638080:12345-192.168.202.15@tcp:35:lhsmtool_posix.0 Request processed in 1140us (1536us total) trans 8589934622 rc 0/0 00010000:00010000:3.0:1787783014.445465:0:14318:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c310823c200) 00010000:00010000:3.0:1787783014.445471:0:14318:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:2.0:1787783014.445475:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 11 00010000:00010000:3.0:1787783014.445477:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6386ea lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787783014.445481:0:14333:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787783014.445486:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c3141204800/0x6d98ed19b6386ea lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.445505:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787783014.445507:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787783014.445509:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787783014.695246:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783014.695363:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904638208 00000100:00100000:3.0:1787783014.695375:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904638208 00000100:00100000:3.0:1787783014.695443:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:3.0:1787783014.695453:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:edb74ad9-50d8-46ec-9312-651fb814f467+8:2349:x1874625904638208:12345-192.168.202.15@tcp:4:dd.0 00010000:00010000:3.0:1787783014.695489:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b6386f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.695510:0:15017:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000335bbc51/0x6d98ed19b6386c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.15@tcp remote: 0x7f762009527e5817 expref: 8 pid: 15013 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.695519:0:15017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787783014.695523:0:15017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787783014.695528:0:15017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b6386f1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.695605:0:15017:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000335bbc51/0x6d98ed19b6386c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5817 expref: 8 pid: 15013 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.695630:0:15017:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000335bbc51/0x6d98ed19b6386c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5817 expref: 8 pid: 15013 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783014.695645:0:15017:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fd2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15017:1874625922447360:192.168.202.15@tcp:104: 00000100:00100000:3.0:1787783014.695763:0:15017:0:(client.c:2715:ptlrpc_set_wait()) set ffff8c312eca7600 going to sleep for 11 seconds 00000100:00100000:1.0:1787783014.699161:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783014.699388:0:15019:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787783014.699400:0:15019:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787783014.700496:0:15017:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fd2c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15017:1874625922447360:192.168.202.15@tcp:104: 00010000:00010000:1.0:1787783014.700531:0:15017:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b6386f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787783014.702394:0:15019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904638336 00000100:00100000:0.0:1787783014.702406:0:15019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904638336 00000100:00100000:3.0:1787783014.703416:0:16561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:3.0:1787783014.703431:0:16561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3119fd3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:edb74ad9-50d8-46ec-9312-651fb814f467+9:2349:x1874625904638336:12345-192.168.202.15@tcp:4:dd.0 00010000:00010000:3.0:1787783014.703780:0:16561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.703801:0:16561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787783014.703806:0:16561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787783014.703811:0:16561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.703821:0:16561:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783014.704003:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783014.704211:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904638464 00000100:00100000:3.0:1787783014.704218:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904638464 00010000:00010000:3.0:1787783014.704256:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000335bbc51/0x6d98ed19b6386c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5817 expref: 10 pid: 15013 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783014.704328:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 14 00000100:00100000:3.0:1787783014.704336:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb74ad9-50d8-46ec-9312-651fb814f467+10:2350:x1874625904638464:12345-192.168.202.15@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787783014.704349:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787783014.704371:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000335bbc51/0x6d98ed19b6386c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5817 expref: 10 pid: 15013 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.704385:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000335bbc51/0x6d98ed19b6386c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5817 expref: 10 pid: 15013 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.704405:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000335bbc51/0x6d98ed19b6386c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.15@tcp remote: 0x7f762009527e5817 expref: 10 pid: 15013 timeout: 599 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.704419:0:14315:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787783014.704423:0:14315:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787783014.704428:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b6386f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.704438:0:14315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b6386f1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.704446:0:14315:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787783014.704448:0:14315:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787783014.704451:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.704483:0:14315:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386f8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.704524:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787783014.704589:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edb74ad9-50d8-46ec-9312-651fb814f467+9:2350:x1874625904638464:12345-192.168.202.15@tcp:103:ldlm_bl.0 Request processed in 253us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783014.704618:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 14 00010000:00010000:0.0:1787783014.704678:0:15017:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b6386f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783014.704688:0:15017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b6386f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.706832:0:16561:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.706850:0:16561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783014.711847:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783014.711932:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783014.711971:0:15019:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787783014.712083:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:0.0:1787783014.712118:0:15019:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1787783014.712504:0:15019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904638592 00000100:00100000:3.0:1787783014.712515:0:15019:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904638592 00000100:00100000:0.0:1787783014.713088:0:16562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904638848 00000100:00100000:0.0:1787783014.713115:0:16562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904638848 00000100:00100000:1.0:1787783014.713437:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:1.0:1787783014.713450:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:edb74ad9-50d8-46ec-9312-651fb814f467+12:2350:x1874625904638592:12345-192.168.202.15@tcp:4:dd.0 00010000:00010000:1.0:1787783014.713494:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000176ef5d/0x6d98ed19b6386ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.713513:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787783014.713518:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787783014.713526:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000176ef5d/0x6d98ed19b6386ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.713551:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000176ef5d/0x6d98ed19b6386ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783014.724041:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783014.724141:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783014.724169:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:2.0:1787783014.724194:0:15019:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1787783014.724202:0:15019:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1787783014.725820:0:16562:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1787783014.725836:0:16562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904639104 00000100:00100000:0.0:1787783014.725844:0:16562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904639104 00000100:00100000:0.0:1787783014.725891:0:16562:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1787783014.725896:0:16562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904638720 00000100:00100000:0.0:1787783014.725899:0:16562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904638720 00000100:00100000:0.0:1787783014.725910:0:16562:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1787783014.725914:0:16562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904638976 00000100:00100000:0.0:1787783014.725916:0:16562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904638976 00000100:00100000:0.0:1787783014.725926:0:16562:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1787783014.725931:0:16562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904639232 00000100:00100000:0.0:1787783014.725934:0:16562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904639232 00000100:00100000:2.0:1787783014.730217:0:16563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:2.0:1787783014.730237:0:16563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:edb74ad9-50d8-46ec-9312-651fb814f467+17:2350:x1874625904638848:12345-192.168.202.15@tcp:4:dd.0 00010000:00010000:2.0:1787783014.730280:0:16563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b8374d/0x6d98ed19b638706 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.730298:0:16563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787783014.730302:0:16563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787783014.730308:0:16563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089b8374d/0x6d98ed19b638706 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783014.730322:0:16563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089b8374d/0x6d98ed19b638706 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783014.822751:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787783014.882029:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:2.0:1787783014.882058:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1787783014.882071:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:3.0:1787783014.888735:0:15017:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:3.0:1787783014.888745:0:15017:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787783013 -> 1787783014 00002000:00010000:3.0:1787783014.888747:0:15017:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787783013 -> 1787783014 00002000:00010000:3.0:1787783014.888750:0:15017:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1787783014.888767:0:15017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b6386f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.888780:0:15017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b6386f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.888789:0:15017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b6386f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.888797:0:15017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a057e00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787783014.888803:0:15017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b6386f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.888836:0:15017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b6386f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.888860:0:15017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b6386f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.888868:0:15017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b6386f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783014.888986:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:edb74ad9-50d8-46ec-9312-651fb814f467+21:2349:x1874625904638208:12345-192.168.202.15@tcp:4:dd.0 Request processed in 193520us (193736us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787783014.888996:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 0 00000100:00100000:3.0:1787783014.889030:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 4 00000100:00100000:3.0:1787783014.889052:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee70f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:edb74ad9-50d8-46ec-9312-651fb814f467+20:2350:x1874625904639104:12345-192.168.202.15@tcp:4:dd.0 00010000:00010000:3.0:1787783014.889128:0:15017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e705c7aa/0x6d98ed19b63870d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.889144:0:15017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787783014.889149:0:15017:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787783014.889156:0:15017:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e705c7aa/0x6d98ed19b63870d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783014.889169:0:15017:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e705c7aa/0x6d98ed19b63870d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787783015.019993:0:15018:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:2.0:1787783015.020007:0:15018:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 8199 00010000:00010000:2.0:1787783015.020027:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000176ef5d/0x6d98ed19b6386ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783015.020040:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000176ef5d/0x6d98ed19b6386ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783015.020048:0:15018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000176ef5d/0x6d98ed19b6386ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783015.021874:0:16561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783015.021898:0:16561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783015.021935:0:16561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783015.021945:0:16561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a057a00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:2.0:1787783015.021949:0:15018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c31029f5000 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:0.0:1787783015.021952:0:16561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783015.021957:0:15018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000176ef5d/0x6d98ed19b6386ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783015.021975:0:15018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000176ef5d/0x6d98ed19b6386ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783015.021975:0:16561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783015.022011:0:15018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000176ef5d/0x6d98ed19b6386ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783015.022019:0:15018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000176ef5d/0x6d98ed19b6386ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.022027:0:16563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b8374d/0x6d98ed19b638706 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.022039:0:16563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089b8374d/0x6d98ed19b638706 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.022048:0:16563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089b8374d/0x6d98ed19b638706 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.022055:0:16563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141204600 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787783015.022060:0:16563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b8374d/0x6d98ed19b638706 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.022069:0:16563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b8374d/0x6d98ed19b638706 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.022085:0:16563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089b8374d/0x6d98ed19b638706 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.022117:0:16563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089b8374d/0x6d98ed19b638706 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787783015.022178:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:edb74ad9-50d8-46ec-9312-651fb814f467+21:2350:x1874625904638592:12345-192.168.202.15@tcp:4:dd.0 Request processed in 308725us (310335us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787783015.022187:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 2 00000100:00100000:2.0:1787783015.022237:0:15018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 5 00000100:00100000:2.0:1787783015.022248:0:15018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:edb74ad9-50d8-46ec-9312-651fb814f467+20:2350:x1874625904638720:12345-192.168.202.15@tcp:4:dd.0 00010000:00010000:2.0:1787783015.022284:0:15018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006ad2150/0x6d98ed19b638714 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783015.022297:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787783015.022301:0:15018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787783015.022309:0:15018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006ad2150/0x6d98ed19b638714 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787783015.022319:0:15018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006ad2150/0x6d98ed19b638714 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783015.025161:0:16563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:edb74ad9-50d8-46ec-9312-651fb814f467+21:2350:x1874625904638848:12345-192.168.202.15@tcp:4:dd.0 Request processed in 294909us (313207us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787783015.025261:0:16563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 3 00000100:00100000:3.0:1787783015.025362:0:16563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 6 00000100:00100000:3.0:1787783015.025383:0:16563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:edb74ad9-50d8-46ec-9312-651fb814f467+20:2350:x1874625904638976:12345-192.168.202.15@tcp:4:dd.0 00010000:00010000:3.0:1787783015.025439:0:16563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b63871b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.025465:0:16563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787783015.025470:0:16563:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787783015.025480:0:16563:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b63871b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.025662:0:16563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b63871b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783015.026416:0:16561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783015.026433:0:16561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003547e954/0x6d98ed19b6386f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787783015.026687:0:16561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3119fd3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:edb74ad9-50d8-46ec-9312-651fb814f467+20:2349:x1874625904638336:12345-192.168.202.15@tcp:4:dd.0 Request processed in 323257us (327532us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787783015.026697:0:16561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 1 00000100:00100000:0.0:1787783015.026736:0:16561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 7 00000100:00100000:0.0:1787783015.026748:0:16561:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c312ee72580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:edb74ad9-50d8-46ec-9312-651fb814f467+19:2350:x1874625904639232:12345-192.168.202.15@tcp:4:dd.0 00010000:00010000:0.0:1787783015.026776:0:16561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9aea343/0x6d98ed19b638722 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783015.026787:0:16561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787783015.026810:0:16561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787783015.026817:0:16561:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9aea343/0x6d98ed19b638722 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787783015.026828:0:16561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9aea343/0x6d98ed19b638722 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787783015.027030:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000001:00080000:3.0:1787783015.027054:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:2.0:1787783015.114226:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:3.0:1787783015.114672:0:15017:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1787783015.114679:0:15017:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1787783015.114699:0:15017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e705c7aa/0x6d98ed19b63870d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.114715:0:15017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e705c7aa/0x6d98ed19b63870d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.114726:0:15017:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e705c7aa/0x6d98ed19b63870d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.114733:0:15017:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a056200 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787783015.114751:0:15017:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e705c7aa/0x6d98ed19b63870d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.114762:0:15017:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e705c7aa/0x6d98ed19b63870d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.114786:0:15017:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e705c7aa/0x6d98ed19b63870d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.114795:0:15017:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e705c7aa/0x6d98ed19b63870d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15017 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783015.114924:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee70f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:edb74ad9-50d8-46ec-9312-651fb814f467+17:2350:x1874625904639104:12345-192.168.202.15@tcp:4:dd.0 Request processed in 225878us (402833us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1787783015.114936:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 4 00000001:00080000:2.0:1787783015.174391:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:2.0:1787783015.174451:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:1.0:1787783015.175160:0:15018:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 16391 00010000:00010000:1.0:1787783015.175192:0:15018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006ad2150/0x6d98ed19b638714 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783015.175208:0:15018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006ad2150/0x6d98ed19b638714 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783015.175217:0:15018:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006ad2150/0x6d98ed19b638714 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783015.175226:0:15018:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141205800 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787783015.175231:0:15018:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006ad2150/0x6d98ed19b638714 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783015.175241:0:15018:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006ad2150/0x6d98ed19b638714 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783015.175293:0:15018:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006ad2150/0x6d98ed19b638714 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783015.175301:0:15018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006ad2150/0x6d98ed19b638714 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783015.175430:0:15018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:edb74ad9-50d8-46ec-9312-651fb814f467+9:2350:x1874625904638720:12345-192.168.202.15@tcp:4:dd.0 Request processed in 153178us (451391us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787783015.175442:0:15018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 5 00010000:00010000:1.0:1787783015.175719:0:16561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9aea343/0x6d98ed19b638722 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783015.175726:0:16561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9aea343/0x6d98ed19b638722 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783015.175731:0:16561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9aea343/0x6d98ed19b638722 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783015.175734:0:16561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c3141255400 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:1.0:1787783015.175736:0:16561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9aea343/0x6d98ed19b638722 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783015.175741:0:16561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9aea343/0x6d98ed19b638722 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783015.175749:0:16561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9aea343/0x6d98ed19b638722 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787783015.175761:0:16561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9aea343/0x6d98ed19b638722 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787783015.175800:0:16561:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee72580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:edb74ad9-50d8-46ec-9312-651fb814f467+7:2350:x1874625904639232:12345-192.168.202.15@tcp:4:dd.0 Request processed in 149057us (451631us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787783015.175805:0:16561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 7 00010000:00010000:3.0:1787783015.176571:0:16563:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b63871b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.176586:0:16563:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b63871b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.176593:0:16563:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b63871b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.176599:0:16563:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c312a057e00 already unused, calling callback (ffffffffc13f5420) 00010000:00010000:3.0:1787783015.176602:0:16563:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b63871b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.176641:0:16563:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b63871b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.176656:0:16563:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b63871b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787783015.176664:0:16563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1d359f7/0x6d98ed19b63871b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787783015.176743:0:16563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c312ee70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:edb74ad9-50d8-46ec-9312-651fb814f467+5:2350:x1874625904638976:12345-192.168.202.15@tcp:4:dd.0 Request processed in 151370us (452600us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787783015.176751:0:16563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 6 00010000:00010000:1.0:1787783015.843628:0:16032:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787783016.547386:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c63e6d-1dfe-4772-affc-638938210ba4:3307:1874625922447488:0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.547493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783016.547554:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874625922448000:0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.547585:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783016.547673:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787783016.547681:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922447872:0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.547705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783016.547737:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922447616:0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.547766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783016.547786:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922448128:0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.547807:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783016.547825:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787783016.547848:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c31070fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922447744:0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.547872:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783016.547911:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922447488 00000100:00100000:3.0:1787783016.547919:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922447488 00000100:00100000:3.0:1787783016.547976:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787783016.547986:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+19:3307:x1874625922447488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.548041:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102edbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:48c63e6d-1dfe-4772-affc-638938210ba4+19:3307:x1874625922447488:12345-0@lo:400:kworker.0 Request processed in 56us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783016.548050:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787783016.548092:0:16030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922448000 00000100:00100000:3.0:1787783016.548117:0:16030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922448000 00000100:00100000:3.0:1787783016.548153:0:16030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922447872 00000100:00100000:3.0:1787783016.548156:0:16030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922447872 00000100:00100000:3.0:1787783016.548168:0:16030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922448128 00000100:00100000:3.0:1787783016.548170:0:16030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922448128 00000100:00100000:3.0:1787783016.548184:0:16030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787783016.548190:0:16030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874625922448000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.548223:0:16030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874625922448000:12345-0@lo:400:kworker.0 Request processed in 33us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783016.548230:0:16030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787783016.548241:0:16030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787783016.548248:0:16030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922447872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.548271:0:16030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874625922447872:12345-0@lo:400:kworker.0 Request processed in 25us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783016.548278:0:16030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787783016.548288:0:16030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787783016.548294:0:16030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922448128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.548333:0:16030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874625922448128:12345-0@lo:400:kworker.0 Request processed in 38us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783016.548340:0:16030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787783016.548413:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922447616 00000100:00100000:3.0:1787783016.548417:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922447616 00000100:00100000:3.0:1787783016.548445:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922447744 00000100:00100000:3.0:1787783016.548447:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922447744 00000100:00100000:3.0:1787783016.548470:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787783016.548476:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922447616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.548508:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922447616:12345-0@lo:400:kworker.0 Request processed in 33us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783016.548515:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787783016.548525:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787783016.548531:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922447744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.548556:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874625922447744:12345-0@lo:400:kworker.0 Request processed in 26us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783016.548562:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787783016.548628:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874625922447872:0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.548639:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070ff0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:48c63e6d-1dfe-4772-affc-638938210ba4:3307:1874625922447488:0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.548648:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070ffc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874625922448000:0@lo:400:kworker.0 00000100:00080000:3.0:1787783016.548679:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787783016.548684:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787783016.548687:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787783016.548704:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922447744:0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.548713:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1787783016.548728:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c312f2c9a40, transno 8589934595 00000004:00080000:3.0:1787783016.548744:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1787783016.548764:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874625922447616:0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.548778:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c31070fd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874625922448128:0@lo:400:kworker.0 00000100:00100000:3.0:1787783016.553294:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c3119fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922448256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787783016.553398:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783016.553487:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8c313c94da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922448384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787783016.553517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787783016.553564:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922448256 00000100:00100000:3.0:1787783016.553574:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922448256 00000100:00100000:3.0:1787783016.553634:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625922448384 00000100:00100000:3.0:1787783016.553638:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625922448384 00000100:00100000:3.0:1787783016.553658:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787783016.553668:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922448256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787783016.553717:0:15016:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1787783016.553770:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874625922448256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783016.553778:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787783016.553798:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787783016.553805:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922448384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787783016.553827:0:15016:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787783016.553859:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874625922448384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783016.553866:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787783016.553916:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c3119fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874625922448256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787783016.553979:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8c313c94da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874625922448384:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787783016.865301:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787783016.958223:0:16601:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1787783017.889948:0:14319:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787783017.999063:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783017.999131:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783017.999154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783017.999180:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783017.999200:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783017.999217:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783017.999239:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.15@tcp (source: 12345-192.168.202.15@tcp) 00000100:00100000:3.0:1787783017.999267:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904639744 00000100:00100000:3.0:1787783017.999277:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904639744 00000100:00100000:3.0:1787783017.999374:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904640000 00000100:00100000:3.0:1787783017.999378:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904640000 00000100:00100000:3.0:1787783017.999393:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904639616 00000100:00100000:3.0:1787783017.999396:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904639616 00000100:00100000:3.0:1787783017.999405:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904640128 00000100:00100000:3.0:1787783017.999407:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904640128 00000100:00100000:3.0:1787783017.999420:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:3.0:1787783017.999429:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edb74ad9-50d8-46ec-9312-651fb814f467+5:2349:x1874625904639744:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787783017.999641:0:16030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904639488 00000100:00100000:1.0:1787783017.999646:0:16030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904639488 00000100:00100000:1.0:1787783017.999683:0:16030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904639872 00000100:00100000:1.0:1787783017.999687:0:16030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904639872 00000100:00100000:1.0:1787783017.999711:0:16030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:1.0:1787783017.999719:0:16030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+20:2349:x1874625904639488:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787783017.999779:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070ffc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edb74ad9-50d8-46ec-9312-651fb814f467+5:2349:x1874625904639744:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 349us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783017.999788:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 15 00000100:00100000:3.0:1787783017.999806:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:3.0:1787783017.999813:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+5:2349:x1874625904640000:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787783018.003406:0:16030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:edb74ad9-50d8-46ec-9312-651fb814f467+20:2349:x1874625904639488:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 3672us (4338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783018.003422:0:16030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 26 00000100:00100000:1.0:1787783018.003480:0:16030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:1.0:1787783018.003496:0:16030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a896bb7-a218-4158-9e10-c8ec78332a42+6:2349:x1874625904639872:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:1.0:1787783018.003603:0:16030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9a896bb7-a218-4158-9e10-c8ec78332a42+6:2349:x1874625904639872:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 113us (4384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787783018.003610:0:16030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 27 00000100:00100000:3.0:1787783018.003988:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070ff0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+5:2349:x1874625904640000:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 4171us (4828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783018.004014:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 16 00000100:00100000:3.0:1787783018.004036:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:3.0:1787783018.004044:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edb74ad9-50d8-46ec-9312-651fb814f467+5:2349:x1874625904639616:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787783018.004078:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070fda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:edb74ad9-50d8-46ec-9312-651fb814f467+5:2349:x1874625904639616:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 36us (4876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783018.004084:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 17 00000100:00100000:3.0:1787783018.004123:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:3.0:1787783018.004132:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c31070ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+5:2349:x1874625904640128:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787783018.004159:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c31070ff840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9a896bb7-a218-4158-9e10-c8ec78332a42+5:2349:x1874625904640128:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 30us (4920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783018.004166:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 18 00000100:00100000:3.0:1787783018.004192:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874625904639360 00000100:00100000:3.0:1787783018.004200:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874625904639360 00000100:00100000:3.0:1787783018.004237:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00100000:3.0:1787783018.004243:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c3102ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:2349:x1874625904639360:12345-192.168.202.15@tcp:400:kworker.0 00000100:00100000:3.0:1787783018.004267:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c3102ed9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74651f07-71e3-4eff-9766-b3b4d7b96d8f+13:2349:x1874625904639360:12345-192.168.202.15@tcp:400:kworker.0 Request processed in 24us (5086us total) trans 0 rc 0/0 00000100:00100000:3.0:1787783018.004273:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.15@tcp, seq: 122 00000100:00080000:3.0:1787783018.004314:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787783018.004319:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787783018.004322:0:14326:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 Debug log: 29904 lines, 29904 kept, 0 dropped, 0 bad.